View all sessions on demand from Smart Security Summit This.
Prophet partnered with Qualcomm to bring a new type of fast image sensor to smartphone cameras.
The “event-based” Metavision technology will allow smartphone cameras to capture fast action compared to today’s image sensors. The company made the announcement to Qualcomm at the Mobile World Congress event in Barcelona.
The idea is to bring the speed, efficiency, and quality of neural-enabled vision to mobile devices.
The technical and business partnership will provide mobile developers with a fast and efficient way
to leverage the ability of the Paris-based Prophesee sensor to dramatically improve camera performance, especially in fast-moving scenes (such as sports scenes) and in low-light conditions, through its groundbreaking event-based continuous and asynchronous pixel sensing method.
In contrast to conventional image sensors, the event-based sensor designed by Prophesee only records what changes in the smartphone image. That allows them to bypass the processing required by other types of sensors that process every single pixel in an image. Prophecy only records changes or events that reflect something changing in a moving image.
Prophesee and Qualcomm have agreed to a multi-year partnership to enable native compatibility between Prophesee’s event-based Metavision Software & Sensors and high-end Snapdragon mobile platforms.
The world is neither raster based nor frame based. Inspired by the human eye, Prophesee’s Event-Based sensors correct for motion blur and other image quality artifacts caused by conventional sensors, especially in dynamic scenes high and low light conditions, bringing Photography and Video closer to our real experience, says Prophesee.
“Prophesee is clearly at the forefront of applying neurotransformation techniques to address the limitations of tradition.
camera and improve the overall user experience. We believe this is game changing technology for
take mobile photography to the next level and our collaboration is both technical and business
Judd Heape, vice president of product management at Qualcomm Technologies, said in a statement. “Their pioneering achievements with the shutter-free capability of event cameras bring a significant improvement to the photographic quality available in the next generation of mobile devices powered by Snapdragon, right even in the most demanding environments, opening up new possibilities for Snapdragon customers. “
Sensors and Metavision software based on the Prophet’s neurotransformation event will be available for high-end Snapdragon mobile platforms. Development kits are expected to be available from Prophesee this year.
“We are delighted to partner with the provider of one of the world’s most popular mobile platforms to
incorporate event-based vision into the Snapdragon ecosystem. Through this partnership, the product
Developers will be able to dramatically enhance the user experience with cameras that deliver images
Luca says quality and performance excellence are not available using only traditional framework-based methods.
Verre, CEO of Prophesee, in a statement.
How it works
The Prophet’s groundbreaking sensors add a new sensor dimension to mobile photography. They change
model in traditional photography by focusing only on changes in the scene, pixel by pixel,
continuously, at extremely high speeds, the companies said.
Each pixel in the Metavision sensor embeds a logic core, allowing it to act as a neuron. They activate themselves intelligently and asynchronously depending on the number of photons they sense. A pixel that fires itself is called an event. In essence, events are driven by the dynamics of the scene, not an arbitrary clock anymore, so the acquisition rate always matches the dynamics of the actual scene.
High performance event-based blurring achieved by frame-based synchronization and Prophesee’s
event-based sensors. The system then fills the gaps between and inside the frames with microsecond events to algorithmically extract pure motion information and correct motion blur.
A development kit with compatibility with Prophet’s sensor technologies
available this year. Prophet has more than 100 engineers and 50 international patents.
VentureBeat’s Mission is to become a digital city square for technical decision-makers to gain knowledge of transformative and transactional enterprise technology. Explore our Briefings.
