Optimizing the Consumption of Spiking Neural Networks with Activity Regularization

dc.contributor.authorNarduzzi, Simon
dc.contributor.authorBigdeli, Siavash. A
dc.contributor.authorLiu, Shih-Chii
dc.contributor.authorDunbar, L. Andrea
dc.date.accessioned2022-10-28T12:00:56Z
dc.date.available2022-10-28T12:00:56Z
dc.date.issued2022-05
dc.description.abstractReducing energy consumption is a critical point for neural network models running on edge devices. In this regard, reducing the number of multiply-accumulate (MAC) operations of Deep Neural Networks (DNNs) running on edge hardware accelerators will reduce the energy consumption during inference. Spiking Neural Networks (SNNs) are an example of bio-inspired techniques that can further save energy by using binary activations, and avoid consuming energy when not spiking. The networks can be configured for equivalent accuracy on a task through DNN-to-SNN conversion frameworks but their conversion is based on rate coding therefore the synaptic operations can be high. In this work, we look into different techniques to enforce sparsity on the neural network activation maps and compare the effect of different training regularizers on the efficiency of the optimized DNNs and SNNs.en_US
dc.identifier.citationProceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, 2022en_US
dc.identifier.doi10.1109/ICASSP43922.2022.9746375
dc.identifier.isbn978-1-6654-0540-9
dc.identifier.urihttps://hdl.handle.net/20.500.12839/1056
dc.identifier.urlhttps://ieeexplore.ieee.org/abstract/document/9746375
dc.language.isoenen_US
dc.rightsCC0 1.0 Universal*
dc.rights.urihttp://creativecommons.org/publicdomain/zero/1.0/*
dc.subjectSparsityen_US
dc.subjectRegularizationen_US
dc.subjectDeep Neural Networksen_US
dc.subjectSpiking Neural Networksen_US
dc.titleOptimizing the Consumption of Spiking Neural Networks with Activity Regularizationen_US
dc.typeProceedingsen_US
dc.type.csemdivisionsDiv-Men_US
dc.type.csemresearchareasData & AIen_US
dc.type.csemresearchareasASICs for the Edgeen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Optimizing_The_Consumption_Of_Spiking_Neural_Networks_With_Activity_Regularization.pdf
Size:
915.18 KB
Format:
Adobe Portable Document Format
Description:
Submitted manuscript
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.82 KB
Format:
Item-specific license agreed upon to submission
Description: