Summary of Tsinghua AI Chip Report Four

Share
/ 2018/11/28 16:14:43 / Tech

We have talked something about AI basics and development as well as the AI scholars at "Summary of Tsinghua AI Chip Report One" and "Summary of Tsinghua AI Chip Report two". In part three"Summary of Tsinghua AI Chip Report three",we learned some knowledge about AI chip industry and trends as well as representative enterprise in AI chip. This part,we will introduce the futher development trends of AI chips.

Five development trends of AI chips

Therefore, the next generation of AI chips will have the following five development trends.

A. Higher Efficient Large Convolution Deconstruction/Multiplexing

On the basis of standard SIMD, CNN can further reduce data communication on bus due to its special multiplexing mechanism. The concept of reuse is particularly important in super-large neural networks. How to decompose and map these super-large convolutions to effective hardware has become a research direction.

B. Lower Inference Computing/Storage Bit Width

One of the biggest evolution directions of AI chips may be the rapid reduction of parameters/computational bit widths of neural networks - from 32-bit floating-point to 16-bit floating-point/fixed-point, 8-bit fixed-point, or even 4-bit fixed-point. In the field of theoretical calculation, the bit width of two or even one bit parameters has gradually entered the field of practice.

C. More customized memory design

When computational components are no longer the bottleneck of the design of neural network accelerators, how to reduce memory access delay will become the next research direction. Usually, the faster the memory is close to the computation, the higher the cost per byte, and the more limited the capacity, so a new storage structure will emerge as the times require.

D. More sparse large-scale vector implementation

Although the neural network is large, in fact, there are many cases of zero input, at this time sparse computing can effectively reduce the useless energy efficiency. The team from Harvard University put forward an optimized five-stage pipeline junction to solve the problem, and output the trigger signal at the last stage. After the Activation layer, the necessity of the next calculation is pre-judged. If it is found that this is a sparse node, the SKIP signal is triggered to avoid the power consumption of multiplication operation, so as to reduce the useless power consumption.

E. Integration of Computing and Storage

The key point of process-in-memory technology is to use new non-volatile storage devices (such as ReRAM) and add neural network computing function to the storage array, thus eliminating data migration operation, that is to say, to realize the integration of computing and storage of neural network processing, in terms of power consumption performance. Significant improvement was achieved.

 

Chi-tung believes that AI technology has made breakthroughs in recent years. As an important physical basis of AI technology, AI chips have great industrial value and strategic position. But from the general trend, it is still in the primary stage of AI chip development, and there is a huge space for innovation in both scientific research and industrial applications. Now not only Yingweida, Google and other international giants have launched new products, Baidu, Ali and other domestic layout in this area, but also the birth of the Cambrian AI chip start-up companies. Under the circumstance that the traditional chip fields such  as CPU and GPU are quite different from the international ones, AI chips in China are expected to overtake in bends.


Keywords: AI Chip
Relevant articles recommend

Hot Products

USD 0.455-0.455/Piece
USD 0.495-0.5/Piece
> 1000 Pieces USD 1.50/Piece
> 100 Pieces USD 1.70/Piece
> 1 Pieces USD 1.90/Piece
> 15000 Pieces USD 1.26444/Piece
> 6000 Pieces USD 1.34140/Piece
> 3000 Pieces USD 1.42936/Piece
USD 1.516-1.52/Piece
Top suppliers

Response Time

24h

Response Rate

100.00%

Product:Microchip,ATMEL,ADI,ON.NXP,TI,MPS,POWER,MAXIM, IR,VISHAY,XILINX,ALTERA,TOSHIBA ,AVAGO.MPS,INFINEON,LITEON
Keming Electronics Development Co., Ltd
4

Response Time

24h

Response Rate

100.00%

Product:Original Semiconductor, NXP,TI,ST,HIT,TOS,NS,ON,FSC,EL,HAR,ITS,NEC,JRC,SHARP,INFINEON,Sunlord,CJ,LRC,Arduino parts,etc.
WINTRONIC INDUSTRIAL HK CO LIMITED
4

Response Time

24h

Response Rate

100.00%

Product:IC,Module, bluetooth chips, RF chips, USB-UART chips
Action Dynamic Tech. (HK) Trading Co.
17

Response Time

24h

Response Rate

100.00%

Product:capacitors,diodes,transistors,MOS,IC
JIESTAR ELECTRONICS CO.,LIMITED
15

Response Time

24h

Response Rate

100.00%

Product:module,IC,Capacitance,resistance,connector
Shenzhen Goodview Global Limited
10

Response Time

24h

Response Rate

100.00%

Product:Allegro,Quectel,RDA,ST,SIMcom,TI,VISHA, MCU,WIFI,BT,2\3\4G,GNSS,NB-IOT
SHENZHEN JINXIDA ELECTRONIC TECHNOLOGY CO.,LTD
12
Contact Us

+86-755-83536845

One to One Customer Service

17190417227