Characteristics of Hebbian-Type Associative Memories with Quantized Interconnections

Pau-Choo Chung, Ching Tsorng Tsai, Yung-Nien Sun

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

The effects of quantized Hebbian-type associative memories (HAM's) on storage capacity and hardware implementations are explored in this paper. The quantizations include a two-level strategy and a three-level strategy using a cutoff threshold in which the interconnection weights of both strategies are restricted to binary memory points on each synapse. The restricted interconnection weights enable a digital or an analog HAM to be implemented more space efficiently. The three-level quantized network with sparse connectivity among neurons has further simplified analog circuits in the dedicated hardwares. Results of simulation and theory show that the three-level quantized network with a properly selected cutoff threshold possesses higher storage capacity than the two-level quantized network.

Original languageEnglish
Pages (from-to)168-171
Number of pages4
JournalIEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications
Volume41
Issue number2
DOIs
Publication statusPublished - 1994 Jan 1

Fingerprint

Data storage equipment
Analog circuits
Computer hardware
Neurons
Hardware

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Cite this

@article{9e9597c44bb94ce2acb350740da60a33,
title = "Characteristics of Hebbian-Type Associative Memories with Quantized Interconnections",
abstract = "The effects of quantized Hebbian-type associative memories (HAM's) on storage capacity and hardware implementations are explored in this paper. The quantizations include a two-level strategy and a three-level strategy using a cutoff threshold in which the interconnection weights of both strategies are restricted to binary memory points on each synapse. The restricted interconnection weights enable a digital or an analog HAM to be implemented more space efficiently. The three-level quantized network with sparse connectivity among neurons has further simplified analog circuits in the dedicated hardwares. Results of simulation and theory show that the three-level quantized network with a properly selected cutoff threshold possesses higher storage capacity than the two-level quantized network.",
author = "Pau-Choo Chung and Tsai, {Ching Tsorng} and Yung-Nien Sun",
year = "1994",
month = "1",
day = "1",
doi = "10.1109/81.269054",
language = "English",
volume = "41",
pages = "168--171",
journal = "IEEE Transactions on Circuits and Systems II: Express Briefs",
issn = "1549-8328",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Characteristics of Hebbian-Type Associative Memories with Quantized Interconnections

AU - Chung, Pau-Choo

AU - Tsai, Ching Tsorng

AU - Sun, Yung-Nien

PY - 1994/1/1

Y1 - 1994/1/1

N2 - The effects of quantized Hebbian-type associative memories (HAM's) on storage capacity and hardware implementations are explored in this paper. The quantizations include a two-level strategy and a three-level strategy using a cutoff threshold in which the interconnection weights of both strategies are restricted to binary memory points on each synapse. The restricted interconnection weights enable a digital or an analog HAM to be implemented more space efficiently. The three-level quantized network with sparse connectivity among neurons has further simplified analog circuits in the dedicated hardwares. Results of simulation and theory show that the three-level quantized network with a properly selected cutoff threshold possesses higher storage capacity than the two-level quantized network.

AB - The effects of quantized Hebbian-type associative memories (HAM's) on storage capacity and hardware implementations are explored in this paper. The quantizations include a two-level strategy and a three-level strategy using a cutoff threshold in which the interconnection weights of both strategies are restricted to binary memory points on each synapse. The restricted interconnection weights enable a digital or an analog HAM to be implemented more space efficiently. The three-level quantized network with sparse connectivity among neurons has further simplified analog circuits in the dedicated hardwares. Results of simulation and theory show that the three-level quantized network with a properly selected cutoff threshold possesses higher storage capacity than the two-level quantized network.

UR - http://www.scopus.com/inward/record.url?scp=0028377949&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028377949&partnerID=8YFLogxK

U2 - 10.1109/81.269054

DO - 10.1109/81.269054

M3 - Article

VL - 41

SP - 168

EP - 171

JO - IEEE Transactions on Circuits and Systems II: Express Briefs

JF - IEEE Transactions on Circuits and Systems II: Express Briefs

SN - 1549-8328

IS - 2

ER -