Sensors Group News
Congratulations to new Dr. Zuowen Wang.
He passed his Phd defense today with a great presentation and answers to committee questions from Martin Schrimph (EPFL), Valerio Mante (INI), Tobi Delbruck (Sensors Group) and supervisor Shih-Chii Liu. Stand by for recording of his presentation.
28-3-2025
Text-to-Events Model presented at WACV EVGen 2025
Ex-Sensor Group member, Joachim Ott, presented the paper “Text-to-Events:Synthetic Event Camera Streams from Conditional Text Input” at the 2025 WACV EVGEN Workshop.
This work describes a new text-to-events model that is able to generate smooth synthetic event camera streams of hand gestures.
2025-03-06
Paper and Demo presented at ISSCC 2025
Congratulations to all authors especially Sheng Zhou and Zixiao Li an ex-Sensor Groups member, Kwantae Kim, for their paper “A 8.62μW, 75dB DR_SoC End-to-End Spoken Language Understanding SoC with Channel-Level AGC and Temporal-Sparsity-Aware Streaming-Mode RNN” which was presented at the 2025 IEEE International Solid-State Circuits Conference (ISSCC).
This chip design demonstrates end-to-end spoken language understanding (SLU) with <10μW. The authors also presented a demo of the SLU chip at the conference.
2025-02-25
Paper acceptances at ISCAS and ICASSP 2025
Congratulations to Longbiao Cheng, and Sheng Zhou for their paper "CustomFit: Customizing Task-Optimized and Size-Specific Subnets from a Single Base Network During Runtime" and to Shu Wang, Ilya Kiselev, and co-authors for their paper, "Online Prediction of Core Body Temperature from Sweat Wearable Printed Sensors Using Recurrent Neural Network" which have been accepted to 2025 IEEE International Symposium on Circuits and Systems (ISCAS 2025).
Congratulations to Longbiao Cheng and co-authors for their paper "Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement " which has been accepted to 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025).
2025-01-25
Paper presented at NeurIPS 2024
Congratulations to Zuowen Wang and the co-authors for their paper "DeltaDEQ: Leveraging heterogeneous convergence for accelerating deep equilibrium iterations" which was presented at NeurIPs 2024.
2024-12-22
Latest paper on dynamic sparsity for low-power audio edge is published in IEEE Solid-state Circuits Magazine 2024
Our latest paper "Bringing Dynamic Sparsity to the Forefront for Low-Power Audio Edge Computing: Brain-inspired approach for sparsifying network updates " is now published in IEEE Solid-State Circuits Magazine 2024.
2024-11-21
Try to beat Dextra
Our prototype of the UZH Science Pavillion exhibit planned for 2025 18 month installation is set up in the INI foyer. Come by and give it a try. Read more about Dextra.
2024-10-20
Shih-Chii's talk on "Hearing with Silicon Cochleas"
Her wonderful talk at NICE 2024 is on YouTube
2014-10-15
Tobi Delbruck's talk on "50 years of silicon retina history"
Presented as replacement INI colloquium Oct 2024
2024-10-15
First Prize in Grand Challenge on Motor Neural Decoding at IEEE BioCAS 2024
Congratulations to Yuanxi Wang and Zuowen Wang for receiving first Prize in the 2024 BioCAS Grand Challenge on Neural Decoding for Motor Control of non-Human Primates. Their paper titled: "Leveraging recurrent neural networks for predicting motor movements from primate motor cortex neural recordings" was presented at the conference.
2024-10-08
Rui Graca SciDVS PhD defense "A Scientific Event Camera"
Check it out on YouTube
2024-10-05
S-C. Liu presents keynote talk at 2024 Neuromorphic Computing Netherlands (NCN2024)
This one day event organized by Prof. Federico Corradi, was held at Eindhoven University of Technology. The event was filled with talks and interactive posters.
See the NCN2024 Program here.
2024-04-24
Congratulations to Dr. Brian McReynolds
He successfully defended his ETH Zurich thesis on "Benchmarking and Pushing the Boundaries of Event Camera Performance for Space and Sky Observations". See Brian's defense presentation on YouTube.
2024-09-13
Paper presented at Interspeech 2024
Congratulations to Longbiao Cheng and colleagues for their paper titled: "Dynamic gated recurrent neural network for compute-efficient speech enhancement" presented at Interspeech in Sep.
2024-09-01
2024-06-08
Event-based Eye Tracking Challenge in AIS at CVPR 2024
Congratulations to Zuowen Wang and ex-members Qinyu Chen and Chang Gao for the successful organization of the Event-based Eye Tracking Challenge in AIS: Vision, Graphics and AI for Streaming CVPR Workshop.
2024-05-18
Paper presented at CVPR 2024
Congratulations to Pehuen Moure and colleagues for their paper at CVPR 2024. Paper titled: "Regularized parameter uncertainty for improving generalization in reinforcement learning".
2024-05-18
Paper presented at IEEE ISCAS 2024
Congratulations to ex-members Qinyu Chen and Chang Gao for their paper at ISCAS 2024. Paper titled: "Epilepsy seizure detection and prediction using an approximate spiking convolutional transformer". The paper won the Best Paper - Honourable Mention Award from the IEEE ISCAS Neural Systems and Application Technical Committee (NSATC).
2024-05-18
Blog of entire CapoCaccia Neuromorphic Workshop
Check out ccnw2024.blogspot.com for a complete blog of the workshop activities. And check out the CCNW2024 final demos video on YT.
2025-05-16
S-C. Liu presents keynote talk at 2024 Neural-inspired Computational Elements (NICE) Conference
The conference ran for three days of inspiring keynotes and lectures, interactive posters, and live demonstrations. The 2023 Misha Mahowald awards were also presented during the conference.
See the NICE Program here.
2024-04-24
Three Sensors Group PhD defenses in one month
A big congratulations to Xi Chen (28 Feb), Joachim Ott (7 Mar), and Rui Graca (22 Mar), who all successfully defended their doctoral thesis within one month. See the PhD theses.
2034-02-24
T Delbruck presents keynote "Noise Limits of Event Cameras" at Huawei Frontiers of Imaging workshop in Cambridge UK
Check out entire talk on YouTube
2024-03-25
T Delbruck presents CSTIC keynote on 50 Years of Silicon Retina History.
The talk was presented remotely at Semicon China CSTIC in Shanghai
Watch the similar talk presented Nov 2023 in the Rockwood Memorial Lecture at UCSD/Salk
2024-03-27
S-C. Liu presents talk at 2024 IEEE ISSCC Forum on Intelligent Sensing
The forum discussed the use of different sparsity types in increasing energy-efficiency of intelligent edge sensing devices.
See the ISSCC Program here.
Tobi Delbrück Talks Caltech, Cameras, and Neural Control
Sunny Bains interviewed Tobi for one of the Brains and Machines EE Times podcast series that focuses on neuromorphic engineering. Check out the podcast.
2024-01-30
Measuring rain droplets with an Event Camera paper published
How do you measure rainfall droplet size distributions? It turns out to be necessary to know the size and speed distribution to infer the volume of water and the erosion effect. Our collaboration with Dr. Joerg Rieckermann at the Swiss Federal Institute of Aquatic Science and Technology (EAWAG) has just appeared in Atmospheric Measurement Techniques.
"Measuring diameters and velocities of artificial raindrops with a neuromorphic event camera" reports a novel rain droplet measurement method that uses a neuromorphic event camera to measure droplet sizes and speeds as they fall through a shallow plane of focus. Experimental results report accuracy similar to a commercial laser sheet disdrometer. Because these measurements are driven by event camera activity, this approach could enable the economical deployment of ubiquitous networks of solar-powered disdrometers. Check out the DVS Disdrometer paper website.
2024-01-27
NeuraViPeR cortical visual prosthetic simulation shown at Scientifica
PhD student Niklas Hahn developed and demonstrated a simulation of possible visual restoration with cortical implant at Scientifica. Check out the video.
The NeuraViPeR project is a consortium of 6 labs and 1 SME across Europe coordinated by Shih-Chii Liu. The Sensors group is developing energy-efficient neural network accelerators receiving visual input and suitable for conveying maximum useful information to subject over the extremely limited implant channel.
2024-01-17
Dextra RoShamBo robot shown at Scientifica
PhD student Xiang Deng built a cool new tendon-driven hand to demo our event camera Dextra robot at Scientifica. Check out the video.
This new spin on our previous Dextra was inspired by a collaboration with Stefan Weirich and Prof. Robert Katzshmann (ETH Soft Robotics Lab) via semester student Nathalie Biere.
Code to run the inference: https://github.com/SensorsINI/dextra-roshambo-python .Original citation: Lungu, Iulia-Alexandra, Federico Corradi, and Tobias Delbruck. 2017. “Live Demonstration: Convolutional Neural Network Driven by Dynamic Vision Sensor Playing RoShamBo.” In *2017 IEEE International Symposium on Circuits and Systems (ISCAS).
2024-01-16
Best poster award at AICAS 2023
Congratulations to Sheng Zhou, Master Student Xi Chen, and Dr. Kwantae Kim for winning the best poster award at AICAS 2023 for their paper: Sheng Zhou, Xi Chen, Kwantae Kim, and Shih-Chii Liu. 2023. “High-Accuracy and Energy-Efficient Acoustic Inference Using Hardware-Aware Training and a 0.34nW/Ch Full-Wave Rectifier.” In *2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)*, 1–5. IEEE. doi:10.1109/AICAS57966.2023.10168561. http://dx.doi.org/10.1109/AICAS57966.2023.10168561 . .
2023-06-23 16:26
Papers presented at IEEE ISCAS 2023
Congratulations to Dr. Kwantae Kim, Dr. Qinyu Chen, and Shu Wang for their papers at ISCAS 2023. Papers titled: " A 3.11 μW 40 nV/√Hz Instrumentation amplifier for bio-impedance sensors exploiting positive-feedback-assisted gain boosting", and "An area-efficient ultra-low-power time-domain feature extractor for edge keyword spotting", and "End-to-end prediction of sodium concentration from uncalibrated sodium ISFETs”.
2023-06-20 15:50
2023 ICASSP paper presented on Continual learning to generate sequences
Congratulations to Joachim Ott on the acceptance of his paper to ICASSP 2023. The paper titled "Biologically-Inspired Continual Learning of Human Motion Sequences", presents a brain-inspired model for generating temporal sequences in the context of continual learning. Ott, Joachim, and Shih-Chii Liu. 2023. “Biologically-Inspired Continual Learning of Human Motion Sequences.” In *2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)*, 1–5. IEEE. doi:10.1109/ICASSP49357.2023.10095490. http://dx.doi.org/10.1109/ICASSP49357.2023.10095490 . 2023-06-20 15:50Cartpole Dancer using RPGD
Check out the cartpole dancer robot that uses our new RPGD MPC optimizer is on YouTube. See RPGD news below.
2023-03-15 07:23
CVPR paper accepted on polarization event camera reconstruction
Congratulations to visiting CSC student Haiyang Mei for his paper with Phd student Zuowen Wang and Tobi Delbruck that was accepted to the main CVPR conference. His paper is about directly reconstructing degree and angle of linear polarization from the "Bio-inspired Polarization Event Camera" PDAVIS, the first integrated polarization event camera, which we constructed as a collaboration with the BioSensors Lab of Viktor Gruev at UIUC.
The CVPR paper is titled "Deep Polarization Reconstruction with PDAVIS Events". See the video Polarization Event Camera (PDAVIS) summary. See also the associated CVPR 2023 Workshop on Event-based Vision demo paper "Live Demo: E2P-Events to Polarization Reconstruction From PDAVIS Events" and the video PDAVIS E2P Demo.
2023-03-08 08:07
Resampling Parallel Gradient Descent MPC optimizer paper accepted to IRCA 2023
Congratulations to the whole neural control team of Frederick, Marcin, Diego, Forian, Xiang, Ennio and Tobi for their great work to get our 2nd real control paper accepted to a major robotics conference. The paper is Heetmeyer, Frederik, Marcin Paluch, Diego Bolliger, Florian Bolli, Xiang Deng, Ennio Filicicchia, and Tobi Delbruck. 2023. “RPGD: A Small-Batch Parallel Gradient Descent Optimizer with Explorative Resampling for Nonlinear Model Predictive Control.” In *2023 IEEE International Conference on Robotics and Automation (ICRA)*, 3218–3224. doi:10.1109/ICRA48891.2023.10161233. http://dx.doi.org/10.1109/ICRA48891.2023.10161233 .
2023-03-08 08:02
Event Sensor Fusion workshop
Min Liu, Shu Wang, and Tobi Delbruck, together with Guang Chen (Tongji U) and Daniel Clarke (Cranfeld U) organized the first workshop on event sensor fusion. Videos of all talks and the final Event Sensor Fusion Jeopardy trivia game are now available!
2022-09-25 12:00
Paper presented at IEEE Interspeech 2024
Congratulations to Longbiao Cheng for their paper at ISCAS 2024. Paper titled: "Epilepsy seizure detection and prediction using an approximate spiking convolutional transformer". The paper won the Best Paper - Honourable Mention Award from the IEEE ISCAS Neural Systems and Application Technical Committee (NSATC).
2024-05-18