Tag: LLM

Technology

Aetina Powers Up Enterprise Edge AI by Introducing NVIDIA MGX Server at COMPUTEX 2024

Jun 4, 2024 by Sujata Muguda 0 Comments #Aetina, #Aetina Powers, #AEX-2UA1, #AI server solutions, #COMPUTEX 2024, #Innodisk Group's AI roadmap, #James Su, #LLM, #Model AEX-2UA1, #NVIDIA MGX Server, #Taipei, #Up Enterprise Edge AI

TAIPEI, June 4, 2024  — Aetina, a subsidiary of the Innodisk Group and an expert in edge AI solutions, is thrilled to announce its innovative SuperEdge NVIDIA MGX short-depth server, model AEX-2UA1, at Computex 2024. The AEX-2UA1 is one of the first x86-CPU short-depth NVIDIA MGX servers to be showcased to the market, marking a significant expansion of Aetina’s product portfolio from specialized edge devices to comprehensive AI server solutions.

Aetina-Announces-Its-Innovative-SuperEdge-NVIDIA-MGX-Short-Depth-Server

The SuperEdge NVIDIA MGX server also represents a milestone in the progression of Innodisk Group’s AI roadmap, extending from frontline sensors and storage devices to AI software tools, computing platforms, and now AI edge servers. The SuperEdge server delivers maximum performance within a compact form factor for edge computing and empowers enterprises to effectively handle sensitive data with private LLM (large language model) and other enterprise AI applications. It is particularly valuable in sectors such as finance and healthcare, where data privacy is paramount, and 5G telco, offering a compact, powerful and space-optimized system ideal for mission-critical applications and deployments.

NVIDIA MGX Server Accelerates On-premises Enterprise AI Deployment

Enterprises are embracing the rapid transformations accelerated by generative AI. However, for industries that handle sensitive data, such as finance, biotech and medical research, cloud-based LLM services can pose potential operational and compliance risks. As a result, these enterprises urgently need a solution that allows LLMs to operate in a secure manner while balancing cost and performance according to their specific cases.

In response to the increasing demand, Aetina unveils the AEX-2UA1, the enterprise-level edge server, to enable enterprises to deploy their private LLM AI training and inferencing on premises. This allows models to be trained using sensitive data and utilized securely to ensure compliance with strict regulations.

Powered by technologies from NVIDIA and Intel, the AEX-2UA1 supports two double-deck GPUs with NVIDIA NVLink bridges and a single Intel® Xeon 6 processor, enhancing LLM training and inferencing performance with direct GPU-to-GPU interconnect to unleash powerful edge computing performance. Furthermore, the AEX-2UA1 supports advanced network solutions, including NVIDIA BlueField-3 DPUs and SuperNICs, and NVIDIA ConnectX-7 NICs. This allows efficient server-to-server and server-to-storage communication for parallel processing in enterprises edge AI systems.

Moreover, to address the space constraints of edge environments, the AEX-2UA1 features an x86 short-depth design. With front access and the compact form factor, it optimizes space utilization, making it suitable for deployments in both rack and non-rack locations. This versatility enables the deployment of diverse AI-driven applications wherever needed at the edge.

Additionally, the AEX-2UA1 complies with the NVIDIA MGX architecture, offering a modular server architecture for maximum flexibility and forward compatibility, including support for NVIDIA Blackwell GPUs, delivering greater scalability for enterprises in the future.

Aetina x Innodisk: Architect Intelligence in the Edge

James Su, Director of Software R&D at Aetina, states, “AEX-2UA1 not only marks Aetina’s advancements in product portfolio extension but also serves as an ideal entry system for enterprises in need of LLM deployment, offering low barriers to entry compared to standard GPU servers in the market. We streamline the development and deployment of AI applications through this NVIDIA MGX server, paired with our extensive expertise, which saves valuable resources while accelerating time to value and empowering organizations to swiftly harness the potential of AI and gain a competitive edge.”

The launch of the new NVIDIA MGX server reaffirms Aetina’s position as the driving force in AI innovation within the Innodisk Group, showcasing its strength and momentum in pushing technological boundaries. Leveraging Innodisk Group’s vast expertise in cross-industry integration and insights from serving IPC clients, Aetina transforms cutting-edge innovations into practical endpoint solutions, facilitating the widespread adoption of edge AI across diverse markets.

Technology

AVEVA previews industrial AI assistant in collaboration with Microsoft at Hannover Messe

May 21, 2024 by Sujata Muguda 0 Comments #a global leader in industrial software, #AI assistant in collaboration with Microsoft, #AVEVA, #AVEVA’s, #Generative AI, #Hannover Messe, #industrial organizations, #Jim Chappell, #LLM, #Matt Kerner, #Microsoft Azure OpenAI Service, #Rob McGreevy

India, 21st May 2024 – AVEVA, a global leader in industrial software, driving digital transformation and sustainability, reinforced collaboration with Microsoft with its industrial AI assistant.

The industrial AI assistant, running on Microsoft Azure OpenAI Service, is a virtual subject matter expert driving the industry 5.0 revolution. It represents a paradigm shift in how industrial organizations answer complex questions in mission-critical environments. The time between curiosity and insight is seconds. AVEVA’s AI assistant acts as a virtual expert, simplifying the vast task of extracting insights from scattered data sets to answer complex, multi-stage questions. Industrial teams can take advantage of large language models (LLM) and generative AI through an intuitive interface that leverages AVEVA’s 50+ years of expertise in industrial software and analytics. Security and trust are built in from the ground up. Analytic quality is enhanced by strict engineering prompts and cross-critique methodologies to ensure that the AI assistant’s answers are robust and transparent, referencing sources and citations. To protect data security and ownership, proprietary data is not blended with the LLM or any other third-party sources.

Rob McGreevy, CPO, AVEVA, said: “When designing AI for industrial settings, we are conscious of the huge responsibility that industries bear to deliver safe, secure, and sustainable processes and results. That is why, as we infuse AI capabilities across our portfolio, we always enrich it with domain-specific expertise that recognizes the requirements and rigors associated with industrial settings. Our industrial AI assistant draws on integrated data combined with the highest levels of security and expertise so that customers can confidently interrogate their information in real time. All of this is available and scalable with Microsoft through our CONNECT intelligence platform.”

Together, AVEVA and Microsoft are accelerating the delivery of industrial intelligence, empowering customers to utilize the power of innovation. With Microsoft’s solutions and AVEVA’s deep industry expertise and software, businesses can capitalize on the power of technology to become more agile, resilient and environmentally sustainable. AVEVA is actively co-innovating with Microsoft. It is among the first industrial independent software vendors to commit to interoperability with Microsoft Fabric and CONNECT (formerly AVEVA Connect).

Sharing more of the detail of the product capabilities, Jim Chappell, Head of AI & Advanced Analytics said: “AVEVA has combined LLM, generative AI (GenAI), and our own patent-pending AI technology to analyze customer data, find issues, and help solve problems. By leveraging the customer’s industrial data and a LLM with the power of AVEVA’s AI capabilities, the user can ask our industrial AI assistant natural language questions with minimal setup required. The user can also ask objective-driven questions which means more complex, multi-step requests can be completed in one single action.”

Matt Kerner, CVP, Microsoft said “Bringing together the AI and cloud capabilities of Microsoft Azure with AVEVA’s expertise in industrial AI has the power to transform how industries can operate at scale. With the intuitive AI assistant interface, it’s easier for operators and executives to benefit from insights, interrogate results and optimize performance.”

Technology

Swecha to Develop TELUGU LLM Corpus & Culture Portal with Engineering Students’ Talent

May 20, 2024 by Sujata Muguda 0 Comments #Artificial intelligence, #Chaitanya Chokkareddy, #Hyderabad, #India-centric LLM, #LLM, #Praveen Chandra, #Swecha, #TELUGU LLM Corpus, #VOZONETEL Communications Pvt Ltd

Hyderabad, 20th May 2024: Swecha, a non-profit organization dedicated to promoting Free Software and Free Knowledge movements; announced a massive internship program on Artificial Intelligence (AI), the ‘SUMMER OF AI’, for over a lakh Engineering students this summer, to equip and make them job ready with AI skills, while aiding Swecha to develop Telugu language centric LLM. This initiative is being undertaken by Swecha, in collaboration with the IIIT Hyderabad; Ozonetel, a leading provider of cloud communication solutions; Meta and TASK. Guests Chaitanya Chokkareddy, CTO, OZONETEL Communications Pvt Ltd.; Y Kiran Chandra, Founder, Swecha; & Praveen Chandra, Secretary, Swecha; briefed media about this project at a press conference, at Swecha, today.

Photos (2) (1)

This initiative is significant, considering that Indian language and India-centric LLM (Large Language Models) are virtually non-existent. India, with its rich culture and a population that constitutes one-sixth of the world, would greatly benefit from having its own LLMs. Most Indian languages are considered low-resource languages, making it challenging to develop LLMs for them. A significant amount of foundational knowledge needs to be compiled and digitized to create the necessary digital data for these languages.

Today, AI is transforming the knowledge landscape by introducing new job functions such as dataset compilation, data cleaning, data labelling, and managing datasets. These roles are essential for building and refining basic models, ensuring the accuracy and effectiveness of AI Applications.

Swecha aims to capitalize on the vast talent pool of engineering students graduating in India and ready to enter the industry, by training them in AI. This presents an opportunity to create a large pool of trained AI engineers, extending well beyond the small group of researchers and developers specialized in deep models.

This project, SUMMER OF AI, attempts to combine the two objectives. A very large scale internship program for first and second year engineering students, trained in basics of AI and then be engaged in very large scale data collection thru interviews. The Project aims to interview people in the villages and towns, collect information and knowledge on various folks, local skills and information, which includes the Telugu folk tales, songs, food, local-places-history and more.

The approach of the project is to collect speech, transcribe the speech and create a dataset for both speech and as a base LLM. In addition to this, the team is also working with few large libraries and Telugu academy to also ingest a lot of books. This process will be done through 100k interns month long internships. we started the first batch with 10k interns. Tools are being built to help with the data collection (at this scale). And at the end of the collection, backend tools needed to create the dataset and also to publish the information on a Teluguwiki like portal. On successful completion of this project, similar approach will be adopted to collect data for other languages and regions also.