人的价值

Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站

我唾弃你的坟墓

A |

    The new ultra-low-power intelligent vision sensor chip "LightTok" developed by a research team from Nanjing University. Photo: from Science and Technology Daily
A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times.
According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition.
"Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information."
Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks.
In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily.
The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said.
The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team.
The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices.
Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage.
The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release.
Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said.
。    《无忧》双线新区正式开放，原汁原味战法道三职业架构，坚守多劳多得的公平核心，整套总价值 7200 元宝新区福利同步上线，散人独行玩家与行会团队站在同一水平线发育，不存在特权压制，所有高阶道具全部依靠副本BOSS产出。新区开启玛法群英榜冲级比拼，榜单前列勇士可以拿下涅槃、轮回系列神兵。龙皇城争霸同步开启，首次占领行会会长收获高额元宝与专属城主头衔，行会全员每日均可领取金币俸禄，攻城守城都能收获实实在在回报。

B | 新角色上线直接领取人物、英雄全套起步套装、坐骑配饰，三职业全套技能一键解锁。高阶装备仅消耗金币即可完成进阶；角色逐级成长，还能解锁成长礼包、可自动切换复活护身的仙魔戒指、回蓝职业勋章，道士还可拿到专属精修技能书，大幅强化实战能力。游戏拥有多条打金路径，圣皇龙殿、卧龙山庄、修罗神殿等诸多副本，BOSS掉落各类兑换道具，可转化为可交易元宝。午间、晚间两场武林竞技轮番开启，胜利即可收获元宝与荣誉，荣誉能够兑换英雄精修点数。圣皇属性对高阶副本增伤大幅提升，幻境多层产出海量升级、升阶素材，刷本练级效率大幅提高。新区不设付费专属地图，装备、通货、材料全部怪物掉落，物价生态稳定。邀约昔日兄弟一同进驻，刷宝 PK、争夺皇城，重温传奇最纯粹的热血体验！。