industry news
Subscribe Now

Fujitsu Develops Deep Learning Acceleration Technology, Achieves World’s Highest Speed

TOKYO, Apr 1, 2019 – (JCN Newswire) – Fujitsu Laboratories Ltd. has developed a technology to improve the speed of deep learning software, which has now achieved the world’s highest speed when the time required for machine learning was measured using the AI Bridging Cloud Infrastructure (ABCI) system, deployed by Fujitsu Limited for the National Institute of Advanced Industrial Science and Technology (AIST).

With the spread of deep learning in recent years, there has been a demand for algorithms that can execute machine learning processing at high speeds, and the speed of deep learning has accelerated by 30 times in the past two years. ResNet-50(1), a deep neural network for image recognition, is generally used as a benchmark to measure deep learning processing speed, comparing training times using image data from the ImageNet Large Scale Visual Recognition Challenge 2012 (ILSVRC2012), a contest of image recognition accuracy.

Based on the technology Fujitsu Laboratories has cultivated over its HPC development, the company has now developed a technology to expand computation volume per GPU without compromising training accuracy. Highly-efficient distributed parallel processing can be provided by appropriately adjusting the learning rate in accordance to the degree of the deep learning training progress. When this newly developed technology was applied to open source deep learning software using 2,048 GPUs in the ABCI system and measured for this benchmark,

Fujitsu Laboratories confirmed that it beats the previous speed record by more than 30 seconds(2), completing the training in 74.7 seconds, the world’s highest speed(2). Fujitsu Laboratories will endeavor to further increase the speed of deep learning, aiming to implement practical applications of this newly developed technology for Fujitsu’s servers and supercomputers.

(1) ResNet-50 A high performance image recognition deep neural network developed by Microsoft. Laboratories’ investigation.
(2) Beat the previous speed record by more than 30 seconds, completing the training in 74.7 seconds, the world’s highest speed as of March 26, 2019, as confirmed by Fujitsu

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.

About Fujitsu Ltd

Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 140,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.1 trillion yen (US $39 billion) for the fiscal year ended March 31, 2018.

Leave a Reply

featured blogs
Jun 14, 2019
The PCI-SIG Developers Conference is a free event for the 800+ member companies that develop and bring to market new products utilizing PCI Express® technology. Granted most people reading this blog won’t be at the conference, but you might be interested...
Jun 14, 2019
By Flint Yoder – Mentor, A Siemens Business Tight schedules? Worried about product reliability? Now you can find and eliminate latch-up sensitivity during schematic design, and avoid those post-layout nightmares. Latch-up'€¦the bane of circuit designers and circuit ve...
Jun 14, 2019
While Our next-generation cloud-ready JasperGold® Formal Verification Platform features machine learning technology and core formal technology enhancements across all JasperGold apps, and... [[ Click on the title to access the full blog on the Cadence Community site. ]]...
Jan 25, 2019
Let'€™s face it: We'€™re addicted to SRAM. It'€™s big, it'€™s power-hungry, but it'€™s fast. And no matter how much we complain about it, we still use it. Because we don'€™t have anything better in the mainstream yet. We'€™ve looked at attempts to improve conven...