ACCESS Newswire

Innodata Inc.

Share
Innodata Releases Open-Source LLM Evaluation Toolkit and Evaluation Datasets and Announces New LLM Trust and Safety Wins

NEW YORK, NY / ACCESSWIRE / April 25, 2024 / Innodata Inc. (NASDAQ:INOD), a leading data engineering company, today announced that it has released an open-source LLM Evaluation Toolkit, together with a repository of 14 semi-synthetic and human-crafted evaluation datasets, that enterprises can utilize for evaluating the safety of their Large Language Models (LLMs) in the context of enterprise tasks.

Using the toolkit and the datasets, data scientists can automatically test the safety of underlying LLMs across multiple harm categories simultaneously. By identifying the precise input conditions that generate problematic outputs, developers can understand how their AI systems respond to a variety of prompts and can identify remedial fine-tuning required to align the systems to the desired outcomes. Innodata encourages enterprise LLM developers to begin utilizing the toolkit and the published data sets as-is. Innodata expects a commercial version of the toolkit and more extensive, continually-updated benchmarking datasets to become available later this year.

Together with the release of the toolkit and the datasets, Innodata published its underlying research around its methods for benchmarking LLM safety. In the paper, Innodata shares the reproduceable results it achieved using the toolkit to benchmark Llama2, Mistral, Gemma, and GPT for factuality, toxicity, bias, and hallucination propensity.

The toolkit, the datasets, and the research are available on GitHub at https://github.com/innodatalabs/innodata-llm-safety.

Innodata began working on trust and safety for one of its Big Tech customers in Q4-2023. In Q1-2024, Innodata won two additional engagements for LLM safety and evaluation - one for a hyperscaler's own foundation models and one for an enterprise customer of the hyperscaler through Innodata's white label program with the hyperscaler. In addition, in Q1-2024, Innodata started pilots for a new customer and an existing customer around LLM trust and safety.

For additional information about Evaluation and Red Teaming in LLMs, see: https://innodata.com/red-teaming-in-llms-unveiling-ai-vulnerabilities/.

About Innodata

Innodata (NASDAQ:INOD) is a global data engineering company delivering the promise of AI to many of the world's most prestigious companies. We provide AI-enabled software platforms and managed services for AI data collection/annotation, AI digital transformation, and industry-specific business processes. Our low-code Innodata AI technology platform is at the core of our offerings. In every relationship, we honor our 30+ year legacy delivering the highest quality data and outstanding service to our customers. Visit www.innodata.com to learn more.

Forward Looking Statements

This press release may contain certain forward-looking statements within the meaning of Section 21E of the Securities Exchange Act of 1934, as amended, and Section 27A of the Securities Act of 1933, as amended. These forward-looking statements include, without limitation, statements concerning our operations, economic performance, and financial condition. Words such as "project," "believe," "expect," "can," "continue," "could," "intend," "may," "should," "will," "anticipate," "indicate," "predict," "likely," "estimate," "plan," "potential," "possible," "promises," or the negatives thereof, and other similar expressions generally identify forward-looking statements.

These forward-looking statements are based on management's current expectations, assumptions and estimates and are subject to a number of risks and uncertainties, including, without limitation, impacts resulting from the continuing conflict between Russia and the Ukraine and Hamas' attack against Israel and the ensuing conflict; investments in large language models; that contracts may be terminated by customers; projected or committed volumes of work may not materialize; pipeline opportunities and customer discussions which may not materialize into work or expected volumes of work; the likelihood of continued development of the markets, particularly new and emerging markets, that our services support; the ability and willingness of our customers and prospective customers to execute business plans that give rise to requirements for our services; continuing reliance on project-based work in the Digital Data Solutions (DDS) segment and the primarily at-will nature of such contracts and the ability of these customers to reduce, delay or cancel projects; potential inability to replace projects that are completed, canceled or reduced; continuing DDS segment revenue concentration in a limited number of customers; our dependency on content providers in our Agility segment; the Company's ability to achieve revenue and growth targets; difficulty in integrating and deriving synergies from acquisitions, joint ventures and strategic investments; potential undiscovered liabilities of companies and businesses that we may acquire; potential impairment of the carrying value of goodwill and other acquired intangible assets of companies and businesses that we acquire; a continued downturn in or depressed market conditions; changes in external market factors; changes in our business or growth strategy; the emergence of new, or growth in existing competitors; various other competitive and technological factors; our use of and reliance on information technology systems, including potential security breaches, cyber-attacks, privacy breaches or data breaches that result in the unauthorized disclosure of consumer, customer, employee or Company information, or service interruptions; and other risks and uncertainties indicated from time to time in our filings with the Securities and Exchange Commission.

Our actual results could differ materially from the results referred to in forward-looking statements. Factors that could cause or contribute to such differences include, but are not limited to, the risks discussed in Part I, Item 1A. "Risk Factors," Part II, Item 7. "Management's Discussion and Analysis of Financial Condition and Results of Operations," and other parts of our Annual Report on Form 10-K, filed with the Securities and Exchange Commission on March 4, 2024, as updated or amended by our other filings that we may make with the Securities and Exchange Commission. In light of these risks and uncertainties, there can be no assurance that the results referred to in the forward-looking statements will occur, and you should not place undue reliance on these forward-looking statements. These forward-looking statements speak only as of the date hereof.

We undertake no obligation to update or review any guidance or other forward-looking statements, whether as a result of new information, future developments or otherwise, except as may be required by the U.S. federal securities laws.

Company Contact

Marcia Novero
Innodata Inc.
Mnovero@innodata.com
(201) 371-8015

SOURCE: Innodata Inc.



View the original press release on accesswire.com

To view this piece of content from www.accesswire.com, please give your consent at the top of this page.

About ACCESS Newswire

DK

Subscribe to releases from ACCESS Newswire

Subscribe to all the latest releases from ACCESS Newswire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from ACCESS Newswire

Jama Connect(R) Attains Level 2 TISAX Certification from TÜV SÜD9.7.2025 13:00:00 CEST | Press release

Jama Connect is the only requirements management application that is both TISAX and SOC 2 certified PORTLAND, OR / ACCESS Newswire / July 9, 2025 / Jama Software®, the industry leading requirements management and traceability solution provider, announced today that it has achieved Level 2 Trusted Information Security Assessment Exchange (TISAX) certification from TÜV SÜD. TISAX is a security standard created by the German Association of the Automotive Industry (VDA). Jama Connect® is now the only requirements management application that is both TISAX and SOC 2 certified. This achievement underscores Jama Software's unwavering commitment to information security and data protection. TISAX certification is a critical benchmark for meeting the stringent security requirements of German OEMs and their global supply chains, ensuring that sensitive customer and product data is handled with the highest standards of confidentiality, integrity, and availability. For our customers, this certificat

AGFA HealthCare Achieves HITRUST I1 Certification, Demonstrating Its Commitment to and Compliance With Data Protection Standards, and Protecting Against Cybersecurity Threats9.7.2025 10:00:00 CEST | Press release

HITRUST certification validates that AGFA HealthCare is operating using leading security practices to protect sensitive information. MORTSEL, BE / ACCESS Newswire / July 9, 2025 / AGFA HealthCare, a leading provider of Imaging IT, today announced that its Enterprise Imaging Solutions earned certified status by HITRUST for information security.AGFA HealthCare HITRUST i1 certification demonstrates that AGFA HealthCare's Enterprise Imaging Solutions are leveraging a comprehensive standard, covering 182 control requirements - including mappings to over 40 authoritative sources - to protect against current and emerging threats. The HITRUST i1 Validated Assessment and Certification allows organizations to demonstrate that they address cybersecurity challenges and remain cyber resilient over time. "HITRUST i1 Certification gives our internal and external stakeholders confidence that we are following leading security practices," said Nathalie McCaughley, President at AGFA HealthCare. Jarius Ja

Champions Oncology Launches Radiopharmaceutical Services Platform, Expands Isotope License, and Screens More Than 30 PDX Models8.7.2025 14:30:00 CEST | Press release

Expanded offering delivers integrated radiopharmaceutical studies using clinically relevant isotopes and highly characterized PDX tumor models HACKENSACK, NJ / ACCESS Newswire / July 8, 2025 / Champions Oncology (NASDAQ:CSBR) a leading translational oncology research organization, today announced the full commercial launch of its radiopharmaceutical services platform. This milestone follows the expansion of the company's radioactive materials license, the completion of the radiochemistry infrastructure, and the successful screening of more than thirty PDX models in collaboration with pharmaceutical and biotech partners. Champions now offers fully integrated radiopharmaceutical workflows combining in vitro, ex-vivo biodistribution, and therapeutic efficacy studies across a wide range of isotopes. The company's platform is uniquely differentiated by its extensive bank of patient-derived xenograft (PDX) tumor models, enabling drug developers to evaluate radiolabeled agents in clinically r

Karbon-X Becomes Official Name Sponsor of BK Dukes Basketball Team8.7.2025 09:00:00 CEST | Press release

CALGARY, AB / ACCESS Newswire / July 8, 2025 / Karbon-X Corp. (OTCQX:KARX), a vertically integrated climate solutions company, has signed a multi-year agreement to become the official name sponsor of BK Dukes, one of Austria's top professional basketball teams. Effective immediately, the team will compete as the BK Karbon-X Dukes. This partnership brings together two high-performance organizations committed to community, innovation, and progress chon and off the court. Fresh off their 2024-2025 Austrian Cup Title win, the BK Dukes are working with Karbon-X to integrate measurable sustainability initiatives throughout the organization. This includes annual emissions reporting, offsetting all team and venue Scope 1, 2, and 3 emissions, and incorporating an emissions offset fee into every ticket purchase to address fan-related impacts. Together, they are building a model of leadership that extends far beyond the scoreboard. "This partnership represents what climate action should look like

Polaris Renewable Energy Announces Q1 2025 Investor Call Details7.7.2025 22:10:00 CEST | Press release

TORONTO, ON / ACCESS Newswire / July 7, 2025 / Polaris Renewable Energy Inc. (TSX:PIF) ("Polaris" or the "Company") is pleased to announce it will be holding its Earnings Conference Call and Webcast to report its Q2 2025 Earnings Results on Thursday, July 31st, 2025, at 10:00 am EST. To listen to the call, please dial Toll Free 888-506-0062 or International Toll-Free Number 973-528-0011 entry code 108489. or URL: https://www.webcaster4.com/Webcast/Page/2773/51833 A digital recording of the earnings call will be available for replay two hours after the call's completion. Replay Call Information: Toronto: 1 877-481-4010, Passcode: 51833 International (toll-free): 1 919-882-2331, Passcode: 51833 Encore Replay Expiration Date: August 14, 2025 About Polaris Renewable Energy Inc. Polaris Renewable Energy Inc. is a Canadian publicly traded company engaged in the acquisition, development, and operation of renewable energy projects in Latin America and the Caribbean. We are a high-performing an

In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.

Visit our pressroom
World GlobeA line styled icon from Orion Icon Library.HiddenA line styled icon from Orion Icon Library.Eye