BrainChip introduces Sequora IP for embedded generative AI

BrainChip introduces Sequora IP for embedded generative AI

BrainChip has introduced Sequora processor IP for embedded sequence processing. Its state-space architecture is intended to limit context-related memory growth while supporting generative models on selected edge hardware.


IN Brief:

  • Sequora is available as licensable processor IP rather than a finished packaged chip.
  • BrainChip says its state-space architecture uses fixed-size context state, but model weights and other memory remain necessary.
  • The company describes model support from millions to three billion parameters, with performance dependent on implementation.

BrainChip has introduced Sequora, a licensable processor IP core intended to run sequential and generative AI workloads in embedded products. The design uses a state-space approach to processing context, extending the company’s processor portfolio beyond the event-based sensing associated with its Akida platform. Sequora is offered as semiconductor design intellectual property, not as a commercially packaged processor available for immediate installation in equipment.

BrainChip is targeting embedded systems where memory capacity, power consumption and cooling are constrained. Some conventional generative model implementations retain growing collections of values describing earlier tokens as a conversation or data stream becomes longer. The resulting memory requirement can restrict the length of a sequence that a particular device can process. The constraint is relevant to autonomous monitoring equipment and other systems that may need to interpret events over time.

Sequora’s state-space architecture updates a fixed-size internal representation as new information arrives. Rather than keeping an ever-growing record of earlier attention values, the processing model maintains a state that can be used when the next input is received. BrainChip claims this avoids context-related growth in that part of working memory, making certain sequential workloads more predictable to allocate.

Fixed state does not mean fixed total memory for every model. Processor instructions, parameters, intermediate calculations, application software and buffers must still be stored, while model size has a substantial influence on the complete requirement. BrainChip describes potential use with networks from several million to three billion parameters. It has not demonstrated that the largest supported model can run with the same power and memory as a small embedded classifier.

The computational work also depends on how the model is represented numerically. Lower-precision formats and compression may reduce some memory and arithmetic demands, but can influence accuracy. External memory access can consume substantial energy in embedded systems, so reducing unnecessary movement of data may benefit electrical efficiency. The size of the saving must be established for the chosen model, implementation technology and operating duty cycle.

Akida has focused on extracting information from sensor signals using event-based processing, an approach intended to avoid performing unnecessary operations when little changes at the input. Sequora addresses a related but different function: interpreting sequences, maintaining context and producing generative responses. BrainChip proposes combining the technologies so a system can recognise a sensor event and process a subsequent sequence without relying entirely on a remote computing service.

Industrial monitoring provides one potential application. A sensor processor might identify changes in vibration, sound or another measurement and pass selected information to a sequence model for further interpretation. The quality of any resulting diagnostic explanation would depend on training data, validation, system design and how the model handles uncertainty. An architecture capable of generating text or other responses does not automatically make those responses safe for autonomous control of machinery.

BrainChip also identifies automotive, medical, aerospace and radar applications. Such systems impose requirements relating to timing, environmental operation and functional assurance that cannot be met by an IP announcement alone. The deterministic size of a model’s context state does not guarantee deterministic output correctness or certification of the complete device.

Sequora is being supplied as synthesizable RTL, accompanied by verification resources, timing and synthesis constraints, a software development kit and model support. These elements provide a starting point for integration into a customer’s system-on-chip. They do not eliminate the engineering work involved in connecting memories and interfaces, establishing clock and power arrangements, validating software and preparing a physical semiconductor design.

The final silicon area, achievable throughput and power consumption depend on the target process, operating frequency and supporting system architecture. BrainChip’s announcement establishes the availability of a new design option for embedded AI developers, with customer manufacturing and measured product performance remaining subsequent steps.


Stories for you