Keep knowledgeable with free updates
Merely signal as much as the Synthetic intelligence myFT Digest — delivered on to your inbox.
China’s efforts to match US computing energy in synthetic intelligence are being hampered by bug-ridden software program, with prospects of main AI chipmaker Huawei complaining about efficiency points and the issue of switching from Nvidia merchandise.
The Chinese language expertise big has emerged because the frontrunner within the race to develop a home different to business chief Nvidia, after Washington additional tightened export controls on high-performance silicon final October.
Its Ascend sequence has develop into an more and more fashionable choice for Chinese language AI teams to run inference, a course of that functions akin to OpenAI’s ChatGPT use to generate responses to queries.
However a number of business insiders, together with an AI engineer at a companion firm, mentioned the chips nonetheless lagged far behind Nvidia’s for the preliminary coaching of fashions. They blamed stability points, slower inter-chip connectivity and inferior software program developed by Huawei referred to as Cann.
Nvidia’s software program platform Cuda is famend as the corporate’s “secret sauce” for being simple for builders to make use of and able to vastly accelerating information processing. Huawei is one in all many corporations attempting to interrupt Nvidia’s stranglehold on AI chips by creating different software program.
Huawei’s personal staff are amongst these complaining about Cann. One researcher, who declined to be named, mentioned it made the Ascend product “troublesome and unstable to make use of” and work on testing it was being hampered.
“When random errors happen, it is extremely troublesome to seek out out the place it comes from because of poor documentation. You want proficient builders to learn the supply code to see what the difficulty is, which slows all the things down. The coding is imperfect,” they mentioned.
One other Chinese language engineer briefed on Baidu’s use of the Huawei processors mentioned the chips crashed regularly, complicating AI growth work.
The Huawei researcher mentioned crashes occurred as a result of it was troublesome to make use of the {hardware}. “It’s simple to get unhealthy outcomes as a result of folks don’t know a lot concerning the {hardware} itself,” they mentioned.
To deal with the issue, Huawei has been sending engineers to assist prospects on website with transferring coaching code beforehand written on Cuda into Cann, in accordance with a number of folks aware of the matter. Baidu, iFlytek and Tencent are among the many tech corporations which have acquired groups of engineers, these folks mentioned.
Huawei declined to remark. Baidu, iFlytek and Tencent didn’t reply to requests for remark.
A former Baidu worker mentioned: “Huawei excels at customer support, so in fact they’ve engineers on website at their massive prospects, serving to them to make use of their chips.”
Huawei can leverage an enormous workforce to speed up the shift. Based on the corporate, greater than 50 per cent of its 207,000 staff work in analysis and growth, together with the engineers dispatched to put in expertise for patrons.
“Huawei’s benefit over Nvidia is it may work intently with its prospects,” mentioned expertise analyst Tilly Zhang at consultancy Gavekal. “In contrast to Nvidia, it has a big workforce of engineers to assist resolve purchasers’ issues and get them to transition to their {hardware}.”
Huawei has additionally arrange a web based portal for builders to offer suggestions on how its software program could be improved.
After US tightened export controls in October, Huawei raised the value of the Ascend 910B, its chip used for coaching, by 20 to 30 per cent, in accordance with folks aware of the matter.
Huawei’s prospects have additionally expressed concern about provide constraints for the Ascend chip, probably because of manufacturing difficulties, with Chinese language corporations prevented from shopping for state-of-the-art chipmaking equipment from the Dutch firm ASML.
Huawei has seen sturdy demand for its AI chips. It reported a 34 per cent enhance in first-half revenues on Thursday, with out offering a breakdown of gross sales for its completely different companies.
Greater than 50 foundational fashions have “been skilled and iterated” on the Ascend chip, Huawei govt director Zhang Ping’an mentioned on the World Synthetic Intelligence Convention in Shanghai in July.
iFlytek has mentioned its massive language mannequin has been skilled completely on Huawei chips after Huawei despatched a gaggle of engineers to its headquarters in Hefei, japanese China, final yr to combine the expertise.