Let’s talk about machine learning at the edge

ARM believes its architecture for object detection could find its way into everything from cameras to dive masks. Slide courtesy of ARM.

You can’t hop on an earnings call or pick up a connected product these days without hearing something about AI or machine learning. But as much hype as there is, we are also on the verge of a change in computing that’s as profound as the shift to mobile was a little over a decade ago. In the last few years, the results of that shift have started to emerge.

In 2015, I started writing about how graphics cores—like the ones Nvidia and AMD make —were changing the way companies were training neural networks for machine learning. A huge component of the improvements in computer vision, natural language processing, and real-time translation efforts have been due to the impressive parallel processing graphics processors have.

Even before that, however, I was asking the folks at Qualcomm, Intel, and ARM how they planned to handle the move toward machine learning, both in the cloud and at the edge. For Intel, this conversation felt especially relevant, since it had completely missed the transition to mobile computing and had also failed to develop a new GPU that could handle massively parallel workloads.

Some of these conversations were held in 2013 and 2014. That’s how long the chip vendors have been thinking about the computing needs for machine learning. Yet it took ARM until 2016 to purchase a company with expertise in computer vision, Apical, and only this week did it deliver on a brand-new architecture for machine learning at low power.

Intel bought its way into this space with the acquisition of Movidius and Nervana Systems in 2016. I still don’t know what Qualcomm is doing, but executives there have told me that its experience in mobile means it has an advantage in the internet of things. Separately, in a conference call dedicated to talking about the new Trillium architecture, an ARM executive said that part of the reason for the wait was a need to see which workloads people wanted to run on these machine learning chips.

The jobs that have emerged in this space appear to focus on computer vision, object recognition and detection, natural language processing, and hierarchical activation. Hierarchical activation is where a low-power chip might recognize that a condition is met and then wake a more powerful chip to provide necessary reaction to that condition.

But while the traditional chip vendors were waiting for the market to tell them what it wanted, the big consumer hardware vendors, including Google, Apple, Samsung—and even Amazon—were building their own chip design teams with an eye to machine learning. Google has focused primarily on the cloud with its Tensor Flow Processing Units, although it did develop a special chip for image processing for its Pixel mobile phones. Amazon is building a chip for its consumer hardware using tech from its acquisition of Annapurna Labs in 2015 and its purchase of Blink’s low-power video processing chips back in December.

Some of this technology is designed for smartphones, such as Google’s visual processing core. Even Apple’s chips are finding their way into new devices (the HomePod caries an Apple A8 chip, which first appeared in Apple’s iPhone 6). But others, like the Movidius silicon, use a design that’s made for connected devices like drones or cameras.

The next step in machine learning for the edge will be to build silicon that’s specific for the internet of things. These devices, like ARM’s, will focus on machine learning with incredibly reduced power consumption. Right now, the training of neural networks happens mostly in the cloud and requires massively parallel processing as well as super-fast I/O. Think of I/O as how quickly the chip can move data around between its memory and the processing cores.

But all of that is an expensive power proposition at the edge, which is why most edge machine learning jobs are just the execution of an already established model, or what is called inference. Even in inference, power consumption can be reduced with careful designs. Qualcomm makes an image sensor that that requires less than 2 milliwatts of power, and can run roughly three to five computer vision models for object detection.

But inference might also include some training, thanks to silicon and even better machine learning models. Movidius and ARM are both aiming to let some of their chips actually train at the edge. This could help devices in the home setting learn new wake words for voice control or, in an industrial setting, be used to build models for anomalous event detection.

All of which could have a tremendous impact on privacy and the speed of improvement in connected devices. If a machine can learn without sending data to the cloud, then that data could stay resident on the device itself, under user control. For Apple, this could be a game-changing improvement to its phones and its devices, such as the HomePod. For Amazon, it could lead to a host of new features that are hard-coded in the silicon itself.

For Amazon in particular, this could even raise a question about its future business opportunities. If Amazon produces a good machine learning chip for its Alexa-powered devices, would it share it with other hardware makers seeking to embrace its voice ecosystem, in effect turning Amazon into a chip provider? Apple and Google likely won’t share. And Samsung’s chip business is for its gear and others, so I’d expect its edge machine learning chips to find their way into the world of non-Samsung devices.

For the last decade, custom silicon has been a competitive differentiator for tech giants. What if, thanks to machine learning and the internet of things, it becomes a foothold for a developing ecosystem of smart devices?

Stacey on IoT | Internet of Things news and analysis

NEWSBYTE: Qualcomm Iaunches IoT wireless edge services

Chip giant Qualcomm has joined the growing number of companies that are delivering edge computing services.

The company’s Qualcomm Technologies subsidiary has announced its new Wireless Edge Services offering. The suite of software services is aimed at helping both enterprise and industrial IoT customers to provision, connect, and manage intelligent wireless devices securely through their cloud platforms.

The company said that the software, “is expected to be exposed through new APIs” and is available on select Qualcomm chipsets – initially the MDM9206 LTE modem for industrial IoT products, MDM9628 LTE modem for automotive products, and QCA4020 for home IoT products. The company will then make the service available on some Snapdragon platforms.

Qualcomm explained that the services are designed to assist in the provisioning and management of huge numbers of connected 4G and 5G devices.

They are also engineered to support what it called a ‘chipsets-as-a-service’ model (CaaS), in which the value of certain chipset capabilities can be realised through discrete services. In addition, the US company claimed that the new offerings would offer protection against compromised devices and network attacks.

“With the introduction of Qualcomm Wireless Edge Services, we continue to evolve and augment our leading Snapdragon portfolio to better serve our expanding base of customers across many industries. And to unlock the potential associated with trusted wireless access to billions of increasingly capable edge devices,” said Serge Willenegger, senior VP and general manager, 4G/5G and industrial IoT, Qualcomm Wireless GmbH.

“We are excited by the initial response from cloud, enterprise and industrial companies and are looking forward to working with them, as well as with our traditional customers to accelerate the transformative opportunity supported by advanced security, intelligence, and wireless connectivity capability at the edge,” he added.

Internet of Business says

The edge environment is getting busier, smarter, and faster as the IoT spreads, and the need for high-speed, low-cost services ramps up. Faster connectivity will be essential, as will the ability to roll out services from interconnected devices swiftly.

Read more: Particle unveils new mesh networking hardware

Read more: Why you could soon have a neural network on your smartphone

IoTBuild is coming to San Francisco, CA on March 27 & 28, 2018 – Sign up to learn all you need to know about building an IoT ecosystem.

IoT Build

The post NEWSBYTE: Qualcomm Iaunches IoT wireless edge services appeared first on Internet of Business.

Internet of Business

Android Oreo ROM unofficially ported to the Galaxy S7 edge

If you recall a few days ago, someone in Vietnam accidentally received an Android Oreo update to their Galaxy S7 edge, complete with the same Samsung Experience 9.0 that is already rolling out to the Galaxy S8 and S8+. Well, it turns out that more than one person got that same update in Vietnam, and one of them offered a system and kernel dump so that a flashable ROM could be made for folks with the Exynos-powered S7 edge with an unlocked bootloader. Thanks to this dump of information, a member of XDA-Developers was able to quickly compile a functional ROM that is based off of the…

GSMArena.com – Latest articles

Samsung Galaxy S6, S6 edge, S6 edge+ and Note 5 could get Android Oreo update soon

It looks like the Samsung Galaxy S6 series, and Note 5 might be getting the Android 8.0 Oreo update. As the North American carrier T-Mobile and Samsung seem to be working closely to make that possible. The support pages say that the update is coming to the Galaxy S6, Galaxy S6 edge, Galaxy S6 edge +, and the Galaxy Note 5. Since the support pages are from Carrier, they are believable and reliable. The support page of each phone says that “T-Mobile and the device manufacturer have agreed to support a new software update.” and there is also a clear mention of “Phase: Complete: Version 8.0 Oreo.” Meaning that the basic development of Oreo for these devices has been completed. It is now carriers turn to clear and work on carrier certifications. The Samsung Galaxy S7 recently received the Oreo update accidentally just ahead of the Galaxy S8 Oreo update adding fuel to the new development. Samsung’s development team a few months back mentioned that the Galaxy S6 possibly won’t end its life cycle on Android 7.0 Nougat which again raised the hopes. Either way, it’s always safe to take the news of this stature with a pinch of salt rather than getting your hopes up. We will let …
Fone Arena