TII
The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.
This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240812019509/en/
UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture (Photo: AETOSWire)
As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.
H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”
For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.
Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”
State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.
Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.
SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.
Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”
Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.
*Source: AETOSWire
To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.
View source version on businesswire.com: https://www.businesswire.com/news/home/20240812019509/en/
About Business Wire
Subscribe to releases from Business Wire
Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.
Latest releases from Business Wire
Tecnotree Recognized in the 2024 Gartner® Hype Cycle™ for Customer Experience and Monetization in the Communications Industry15.1.2025 15:57:00 CET | Press release
Tecnotree, a global leader in digital Business Support System (BSS) provider and a transformation solution, is thrilled to announce its inclusion in the 2024 Gartner Hype Cycle for Customer Experience and Monetization in the Communications Industry. We believe, this acknowledgment highlights Tecnotree’s pioneering role in delivering Partner Ecosystem Management Platforms, AI for CSP Customer Interactions, and CSP Digital Marketplaces. The Gartner Hype Cycle serves as a trusted guide for evaluating the maturity and adoption of transformative technologies in the communications sector. In our opinion. Tecnotree’s recognition underscores its ability to enable Communication Service Providers (CSPs) to streamline operations, create innovative revenue opportunities, and deliver hyper-personalized customer experiences. Tecnotree’s Partner Ecosystem Management Platforms empower CSPs to seamlessly onboard, integrate, and manage diverse partners, unlocking new revenue streams through collaborativ
Fluence Wins Cultivation Technology of the Year at 2024 Emjays15.1.2025 15:00:00 CET | Press release
Fluence was awarded Lighting Company of the Year at the Emjays’ inaugural program in 2023 Fluence, a leading global provider of energy-efficient LED lighting solutions for commercial cannabis production, won back-to-back Emjays International Cannabis Awards, taking home Cultivation Technology of the Year during MJBizCon 2024. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20250115876512/en/ Fluence wins Cultivation Technology of the Year at the Emjays International Cannabis Awards during MJBizCon 2024 (photo courtesy of the Emjays) The Emjays is a collaboration between award-winning event producers Farechild Events and MJBizCon, the cannabis industry’s largest trade show and media entity. The program is dedicated to recognizing leaders and innovators in more than 20 ancillary business categories within the cannabis industry. Fluence was named Lighting Company of the Year at the program’s inaugural event in 2023. “As the global
BlueFlag Security Named an IDC Innovator for Software Development Life-Cycle Identity and Access15.1.2025 15:00:00 CET | Press release
One of only three vendors included in the report, the BlueFlag platform provides a unified, context-rich, and identity centric view of risks across all key SDLC attack vectors including developer identities, toolchains, and code BlueFlag Security, a leader in software development lifecycle (SDLC) security and governance, is proud to be named an IDC Innovator in the report, IDC Innovators: Software Development Life-Cycle Identity and Access, 2024 (Doc # US52748124, December 2024). IDC Innovator reports recognize emerging vendors offering innovative new technology that alleviates challenges facing IT and security buyers. The IDC Innovators report noted, “SDLC identity and access solutions reduce the risk of credential compromise, unauthorized access, and lateral movement within development environments. They play a critical role in safeguarding the software supply chain by ensuring only legitimate identities can interact with sensitive systems and data.” The report shared about BlueFlag
Diligent Announces Market Insights Reporting Powered by S&P Global Market Intelligence, Giving Directors and Executives Unrivaled Financial and Risk Insights15.1.2025 15:00:00 CET | Press release
New reports bring key financial insights and market comparisons to directors, CFOs, general counsel and executives, giving clarity into investor risks. Diligent, a leading GRC SaaS company, today announced it is collaborating with S&P Global’s Market Intelligence division to launch Diligent Market Insights Reporting. Powered by S&P Capital IQ Pro data, the reports give corporate directors and executives timely, contextualized insights into global financial data and peer performance – including market sentiment, analyst consensus, peer developments and industry analysis – to stay ahead of market and investor risks. The reports are built within the Diligent One Platform, Diligent’s leading GRC platform empowering more than 1 million users and 700,000 board members and leaders to make better decisions. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20250115272711/en/ (Graphic: Business Wire) “Today’s corporate directors are navig
Shippeo Raises $30m Strategic Round Led by Woven Capital to Accelerate US and APAC Expansion15.1.2025 15:00:00 CET | Press release
Shippeo’s commitment to shipping data quality and innovation drives customer and revenue growth as it expands globally. Shippeo, a global leader in real-time multimodal transportation visibility, today announced a $30 million strategic funding round led by Woven Capital, Toyota’s growth fund, with participation from existing investors: Battery Ventures, Partech, NGP Capital, Bpifrance Digital Venture, LFX Venture Partners, Shift4Good, and Yamaha Motor Ventures. This new funding will support Shippeo’s accelerated expansion across North America and APAC while driving enhancements to its industry-leading Real-Time Transportation Visibility Platform. With this round, Shippeo’s total funding exceeds $140 million. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20250113725048/en/ Shippeo offers real-time shipment tracking across all transport modes, helping companies create sustainable, resilient supply chains. Its platform enables u
In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.
Visit our pressroom