Qualcomm’s betting on AI to take on Apple and Google’s chips
7th-gen AI in action
What can the new AI unit do?
Vinesh Sukumar, Head of AI/ML Product Management at Qualcomm, said the new AI unit can handle a lot more workload easily. The company developed a demo with video imaging company Arcsoft, where a prototype phone based on the Snapdragon 8 Gen 1 could simultaneously perform face detection and apply the face bokeh effect.
Sukumar said that the new tech allows the software to detect more than 20 points on the face, so app makers can apply effects even when there’s a bad angle or small field of view.
The new sensing hub enables the chip to have always-on camera experiences for face and object detection while consuming low power.
There’s also a new ‘always secure’ module within the sensing hub that allows apps to conduct financial transactions in a safer way.
Why is Qualcomm partnering with companies for different experiences?
Until now, Qualcomm chips usually provided phone makers with a canvas to draw their own paintings. While that still might be the case, this year, the company is partnering with many firms to give different AI-powered experiences a bit more flair.
First, for an enhanced camera experience, including charming black and white shots and bokeh effects, Qualcomm is partnering with the German imaging company Leica. It has previously worked with manufacturers such asHuawei and Xiaomi. But this is a rare occasion when a chipmaker is working with a camera maker exclusively.
Sukumar said camera maker Leica was a key partner in developing AI to capture high-quality and dense images with great spatial details. He said that this tech will enhance dynamic range and clarity in pictures.
Qualcomm also partnered with health organizationSondeto showcase an app that records your voice for 30 seconds and detects your stress levels, asthma condition, and even COVID-19.
This is not entirely novel: Israeli startup Vocalishas achieved a similar feat with an app, but in Qualcomm’s case, all the processing is done locally to keep the user privacy intact.
One of the most important partnerships is withHugging Face, an open-source startup working on language-based machine learning models. Qualcomm demoed a smart assistant which uses sentiment analysis to classify the most important notifications for you. Plus, you can look at a summary of notifications based on their priority.
The assistant can also answer questions like “Where’s my dinner meeting?” and “When should I leave?”
All this reminded me of Google Assistant. But Qualcomm’s Vice President and Head of AI Software, Jeff Gehlhaar, told me that this partnership will bring a broader portfolio of use cases. I’d be very interested to see an assistant that has better capabilities than Google Assistant, so bring it on Qualcomm.
What’s in it for developers?
Qualcomm said this year it’s introducing support formixed-precision instructionsin its SDK, so developers can make their AI models run faster while using less memory.
However, the biggest change is to introduce Neural architecture search (NAS) for Qualcomm chips. NAS enables data scientists to optimize a model for particular hardware without manually training it. They can also put constraints on the model’s size or other parameters based on the use case.
The chipmaker is partnering with Google Cloud to provide the backbone for this NAS offering. Qualcomm will use the Google Vertex AI solutionfor managed machine learning, so developers can train their models for its chips easily.
This partnership will allow developers to tune their models not just for mobile, but for Qualcomm’s XR, IoT, and automotive solutions as well.
A battle with Apple, Samsung, and Google
Apple always had its own chips on its iPhones, while Samsung uses a mix of its indigenous Exynos processors and Qualcomm’s Snapdragon processors for its devices.
This year, Google ditched Qualcomm for the first time, so the competition in the chip market is definitely heating up.
The US-based chip giant will need to show its processors are as capable as Apple’s, Samsung’s, or Google’s, if not better. And for that, it’s putting the onus on its AI chops.
It’ll be amazing to see companies like OnePlus, Samsung, or Xiaomi using Qualcomm’s new gear to bring out an AI experience that we’ve not seen on iPhones or Pixels. Game on!
Story byIvan Mehta
Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That’s one heck of a mixed bag. He likes to say “Bleh.“Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That’s one heck of a mixed bag. He likes to say “Bleh.”
Get the TNW newsletter
Get the most important tech news in your inbox each week.
