Qualcomm TensorFlow Lite SDK Software User Guide
Nalane ea ntlafatso
| Khatiso | Letsatsi | Tlhaloso |
| AA | Loetse 2023 | Tokollo ea pele |
| AB | Mphalane 2023 |
|
Kenyelletso ea lisebelisoa tsa Qualcomm TFLite SDK
Lisebelisoa tsa nts'etsopele ea software ea Qualcomm TensorFlow Lite (Qualcomm TFLite SDK) li fana ka moralo oa TensorFlow Lite bakeng sa inferencing ea bohlale ba maiketsetso (AI), e thusang baetsi ba lits'ebetso ho nts'etsapele kapa ho tsamaisa lits'ebetso tse loketseng tsa AI.
Tokomane ena e fana ka litaelo tsa mohato ka mohato ho bokella Qualcomm TFLite SDK e ikemetseng le ho theha tikoloho ea ntlafatso. Sena se nolofalletsa ts'ebetso ea moqapi, e kenyeletsang:
- ho theha tikoloho ea kaho moo mohlahlami a ka bokellang Qualcomm TFLite SDK
- ho nts'etsapele lits'ebetso tse ikemetseng tsa Qualcomm TFLite SDK
Ho fumana tšehetso, bonahttps://www.qualcomm.com/ts'ehetso. Palo e latelang e fana ka kakaretso ea tšebetso ea Qualcomm TFLite SDK: ”
Setšoantšo sa 1-1 Qualcomm TFLite SDK workflow
Sesebelisoa se hloka SDK ea sethala le tlhophiso file (Mofuta oa JSON) ho hlahisa li-artifact tsa Qualcomm TFLite SDK.
Ho aha ts'ebeliso ea ho qetela o sebelisa multimedia, AI, le komporo ea pono (CV) subsystems, bona Qualcomm Intelligent Multimedia SDK (QIM SDK) Quick Start Guide (80-50450-51).
Tafole e bonts'a 'mapa oa mofuta oa Qualcomm TFLite SDK e nang le tokollo ea CodeLinaro tag:
Lethathamo la 1-1 Litaba tsa tokollo
| Mofuta oa Qualcomm TFLite SDK | Ho lokolloa ha CodeLinaro tag |
| V1.0 | Qualcomm TFLITE.SDK.1.0.r1-00200-TFLITE.0 |
Lethathamo la 1-2 Liphetolelo tsa Qualcomm TFLite SDK tse tšehelitsoeng
| Qualcomm Mofuta oa TFLite SDK | Sehlahisoa sa software se tšehelitsoeng | Mofuta oa TFLite o tšehetsoeng |
| V1.0 | QCS8550.LE.1.0 |
|
|
||
|
||
|
||
|
||
|
Litšupiso
Lethathamo la 1-3 Litokomane tse amanang
| Sehlooho | Nomoro |
| Qualcomm | |
| 00067.1 Release Note for QCS8550.LE.1.0 | RNO-230830225415 |
| Qualcomm Intelligent Multimedia SDK (QIM SDK) Tataiso ea ho Qala ka Potlako | 80-50450-51 |
| Qualcomm Intelligent Multimedia SDK (QIM SDK) Reference | 80-50450-50 |
| Lisebelisoa | |
| https://source.android.com/docs/setup/start/initializing | – |
Lethathamo la 1-4 Litlhaloso le litlhaloso
| Kgutsufatso kapa lereho | Tlhaloso |
| AI | Bohlale ba maiketsetso |
| BIOS | Sistimi ea mantlha ea ho kenya / tlhahiso |
| CV | Pono ea k'homphieutha |
| IPK | Sephutheloana sa eona file |
| QIM SDK | Qualcomm Intelligent multimedia software development kit |
| SDK | Setsi sa nts'etsopele ea software |
| TFLite | TensorFlow Lite |
| XNN | Xth moahisane ya haufi |
Beha tikoloho ea ho aha lisebelisoa tsa Qualcomm TFLite SDK
Lisebelisoa tsa Qualcomm TFLite SDK li lokolloa ka mokhoa oa mohloli; ka hona, ho theha tikoloho ea kaho ho e bokella ke tlamo empa ho hlophisoa ha nako e le 'ngoe.
Lintho tse hlokahalang
- Netefatsa hore o na le monyetla oa ho fumana mochini o amohelang Linux.
- Netefatsa hore mofuta oa moamoheli oa Linux ke Ubuntu 18.04 kapa Ubuntu 20.04.
- Eketsa boholo ba litebelo tsa basebelisi le maemo a mangata a basebelisi ho sistimi e amohelang batho.
- Kenya mela ea litaelo ho/etc/sysctl.confand qala moamoheli bocha: fs.inotify.max_user_instances=8192 fs.inotify.max_user_watches=542288
Kenya liphutheloana tse hlokahalang tsa moamoheli
Liphutheloana tsa moamoheli li kentsoe mochining oa moamoheli oa Linux.
Matha litaelo tsa ho kenya liphutheloana tse amohelang baeti: $ sudo apt install -y jq $ sudo apt install -y texinfo chrpath libxml-simple-perl openjdk-8-jdkheadless
Bakeng sa Ubuntu 18.04 le ho feta:
$ sudo apt-fumana ho kenya git-core gnupg flex bison ea bohlokoa ea zip curl zlib1g-dev gcc-multilib g++-multilib libc6-dev-i386 libncurses5 lib32ncurses5- dev x11proto-core-dev libx11-dev lib32z1-dev libgl1-mesa-dev libxml2 fontprouti
Ho fumana lintlha tse ling, bona https://source.android.com/docs/setup/start/initializing.
Beha tikoloho ea li-docker
Docker ke sethala se sebelisetsoang ho aha, ho nts'etsapele, ho leka le ho fana ka software. Ho bokella SDK, docker e tlameha ho hlophisoa mochining oa moamoheli oa Linux.
Netefatsa hore ts'ebeliso ea CPU e lumelletsoe mochining o amohelang Linux. Haeba e sa lumelloa, etsa se latelang ho e nolofalletsa ho tsoa ho litlhophiso tsa tlhophiso ea "Input Input" (BIOS):
- Numella virtualization ho tsoa BIOS:
a. Tobetsa F1 kapa F2 ha sistimi e qala ho kena BIOS. Fensetere ea BIOS e hlaha.
b. Fetolela ho Advanced tab ya.
c. Karolong ea CPU Configuration, seta Virtualization Technology ho Nobled.
a. Tobetsa F12 ho boloka le ho tsoa, ebe o qala sistimi bocha.
Haeba mehato ena e sa sebetse, latela litaelo tse tobileng tse tsoang ho mofani oa tsamaiso ho nolofalletsa ho sebelisa virtualization - Tlosa mehlala efe kapa efe ea khale ea docker:
$ sudo apt tlosa docker-desktop
$ rm -r $HOME/.docker/desktop
$ sudo rm /usr/local/bin/com.docker.cli
$ sudo apt purge docker-desktop - Beha sebaka sa polokelo e hole sa docker:
$ sudo apt-fumana ntjhafatso $ sudo apt-fumana li-certificate tsa curl gnupg lsb-e lokolla $ sudo mkdir -p / joalo-joalo/apt/keyrings $ curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg - dearmor -o /etc/apt/keyrings/docker.gpg $ echo "deb [arch=$(dpkg -print-architecture) sign-by=/etc/apt/ keyrings/ docker.gpg] https:// download.docker.com/linux/ubuntu $ (lsb_release -cs) e tsitsitseng” | sudo tee /etc/apt/sources.list.d/ docker.list > /dev/null - Kenya enjine ea docker:
$ sudo apt-fumana ntjhafatso $ sudo apt-fumana kenya docker-ce docker-ce-cli - Kenya mosebelisi ho sehlopha sa docker:
$ sudo groupadd docker $ sudo usermod -aG docker $USER - Qala sistimi hape.
Hlahisa SDK ea sethala
SDK ea sethala ke tlhokahalo e tlamang ho bokella lisebelisoa tsa Qualcomm TFLite SDK. E fana ka litšepiso tsohle tse hlokahalang tsa sethala tse hlokoang ke Qualcomm TFLite SDK.
Etsa se latelang ho hlahisa SDK ea sethala:
- Etsa moralo bakeng sa sehlahisoa sa software se ratoang.
Litaelo tsa ho aha tokollo ea QCS8550.LE.1.0 li fanoe ho lintlha tsa tokollo. Ho fihlella lintlha tsa tokollo, sheba References.
Haeba litšoantšo li ne li hahiloe pele, etsa mohato oa 2, ebe u theha mohaho o hloekileng. - Etsa taelo e latelang ho aha litšoantšo tsa sebaka sa mosebelisi le sethala sa SDK:
Bakeng sa QCS8550.LE.1.0, eketsa karolo ea mochini qti-tflite-delegate ho MACHINE_FEATURES ho kalama.conf file le ho fana ka tikoloho ea moaho ho latela litaelo tse tsoang ho lintlha tsa tokollo.
Kamora ho hlahisa litšoantšo tsa sebaka sa mosebelisi ho tloha moahong, tsamaisa taelo e latelang ho hlahisa sethala sa SDK.
$ bitbake -fc populate_sdk qti-robotics-setšoantšo
Haha lisebelisoa tsa Qualcomm TFLite SDK - ntšetso-pele ea mosebetsi
Ts'ebetso ea lisebelisoa tsa Qualcomm TFLite SDK e hloka hore moqapi a fane ka tlhophiso file ka likenyo tse nepahetseng. Mengolo ea likhetla tsa mothusi ho tsoa ho projeke ea lisebelisoa tsa tflite (e teng sefateng sa mohloli oa Qualcomm TFLite SDK) e fana ka mesebetsi ea mothusi ho theha tikoloho ea khetla, e ka sebelisoang bakeng sa phallo ea mosebetsi ea Qualcomm TFLite SDK.
Moqapi o haha liporojeke tsa Qualcomm TFLite SDK ka har'a sets'oants'o mme o hlahisa lintho tsa khale a sebelisa lisebelisoa tse fanoeng ke lisebelisoa tsa tflite.
Kamora hore setshelo sa Qualcomm TFLite SDK se hahuoe, mohlahlami a ka hokela setshelo mme a sebelisa lisebelisoa tsa mothusi tikolohong ea khetla bakeng sa nts'etsopele e tsoelang pele.
- Ho na le tokisetso ea ho kenya li-artifact tsa Qualcomm TFLite SDK ho sesebelisoa sa Qualcomm se hokahaneng le moamoheli oa Linux ka USB/adb.
- Ho boetse ho na le tokisetso ea ho kopitsa lintho tsa khale tsa Qualcomm TFLite SDK ho tloha ka har'a setshelo ho ea mochining o mong oa moamoheli moo sesebelisoa sa Qualcomm se hokahaneng.
Palo e latelang e thathamisa lisebelisoa tse fumanehang ka mor'a ho theha tikoloho ea kaho ea setshelo u sebelisa mangolo a thusang ho aha Qualcomm TFLite SDK.
Setšoantšo se bontša tatellano ea ts'ebetso ea lisebelisoa:
Setšoantšo sa 4-3 Tatelano ea lisebelisoa ho moamoheli
Kopanya le ho haha Qualcomm TFLite SDK
Qualcomm TFLite SDK e bokelloa ha setšoantšo sa docker se etsoa. Ho hokahanya le ho aha Qualcomm TFLite SDK, etsa se latelang:
- Theha directory ho moamoheli file mokhoa oa ho hokahanya sebaka sa mosebetsi sa Qualcomm TFLite SDK. Bakeng sa
exampLe: $mkdir $cd - Fumana khoutu ea mohloli oa Qualcomm TFLite SDK ho CodeLinaro:
$ repo init -u https://git.codelinaro.org/clo/le/sdktflite/tflite/ manifest.git -repo-branch=qc/stable -repo-url=git://git.quicinc.com/ tools/repo.git -m TFLITE.SDK.1.0.r1-00200-TFLITE.0.xml -b lokolla && repo sync -qc -no-tags -j - Theha directory ho moamoheli file sistimi e ka kenngoa ho docker. Bakeng sa mohlalaample: mkdir-p / Bukana ena e ka etsoa kae kapa kae mochineng o amohelang Linux, 'me ha e itšetlehe ka hore na morero oa Qualcomm TFLite SDK o hokahanngoa hokae. Kamora hore mosebetsi o phetheloe ka har'a setshelo, li-artifacts tsa Qualcomm TFLite SDK li ka fumanoa bukeng e entsoeng mohatong ona.
- Fetola tlhophiso ea JSON file e teng ho /tflite-tools/ targets/le-tflite-tools-builder.json e nang le lintlha tse latelang:
“Setšoantšo”: “tflite-tools-builder”, “Device_OS”: “le”, “Additional_tag”: “”, “TFLite_Version”: “2.11.1”, “Delegates”: {“Hexagon_delegate”: “OFF”, “Gpu_delegate”: “ON”, “Xnnpack_delegate”: “ON” }, “TFLite_rsync_destination”: “ /”, “SDK_path”: “/build-qti-distro-fullstack-perf/tmpglibc/deploy/sdk>”, “SDK_shell_file”: “”, “Base_Dir_Location”: “” }
Bakeng sa tlhaiso-leseling e batsi ka likenyo tse boletsoeng ho json configuration file, bona Docker.md readme file ho /tflite-tools/.
HLOKOMELA Bakeng sa QCS8550, moemeli oa Qualcomm® Hexagon™ DSP ha a tšehetsoe. - Fumana mongolo ho theha tikoloho:
$ cd /tflite-tools $ mohloli ./scripts/host/docker_env_setup.sh - Haha setšoantšo sa docker sa Qualcomm TFLite SDK: $ tflite-tools-host-build-image ./targets/le-tflite-tools-builder.json Haeba setupo sa moaho se hloleha, bona Troubleshoot docker setup. Ka mor'a ho qeta ka katleho, molaetsa o latelang o hlahisoa: "Boemo: Haha setšoantšo se phethiloe ka katleho!!" Ho matha mohato ona ho haha Qualcomm TFLite SDK hape.
- Matha sejana sa docker sa Qualcomm TFLite SDK. Sena se qala setshelo ka tags e fanoe ka tlhophiso ea JSON file. $tflite-tools-host-run-container ./targets/le-tflite-tools-builder.json
- Hokela setshelo se qalileng ho tloha mohatong o fetileng.
$ docker e kopanya
Qualcomm TFLite SDK e hlophisitsoe, 'me lintho tsa khale li se li loketse ho sebelisoa kapa ho feta
e sebelisetsoang ho hlahisa plug-in ea QIM SDK TFLite.
Hokela sesebelisoa ho amohela le ho tsamaisa lintho tsa khale]
Ka mor'a ho bokella, ho na le mekhoa e 'meli ea ho hokahanya mochine ho moamoheli le ho tsamaisa thepa
Lintho tsa khale tsa Qualcomm TFLite SDK.
- Sesebelisoa se hoketsoeng ho moamoheli oa lehae oa Linux:
Moqapi o hokela sesebelisoa setsing sa mosebetsi ebe o kenya li-artifacts tsa Qualcomm TFLite SDK ho tsoa setshelo ka kotloloho sesebelisoa (QCS8550). - Sesebediswa se hoketswe ho moamohedi o hole:
Moqapi o hokela sesebelisoa sebakeng sa ho sebetsa se hole, 'me a ka sebelisa litaelo tsa "pack manager installer" ho li-platform tsa Windows le Linux ho kenya li-artifacts tsa Qualcomm TFLite SDK ho sesebelisoa (QCS8550)
Setšoantšo sa 4-4 Khokahano ea boto ea lisebelisoa ho nts'etsopele le sebaka sa ho sebetsa se hole
Hokela sesebelisoa sebakeng sa mosebetsi
Sesebelisoa se hoketsoe setsing sa mosebetsi mme setshelo sa nts'etsopele se ka fihlella sesebelisoa ka USB/adb.
Setšoantšo se bontša stage ka tatellano ea ts'ebetso ea Qualcomm TFLite SDK:
- Etsa litaelo tse latelang ho kenya li-artifacts ho sesebelisoa:
$ tflite-lisebelisoa-sesebediswa-lokisa
$ tflite-tools-device-deploy - Ho hlakola li-artifacts, tsamaisa taelo e latelang:
$ tflite-tools-sesebelisoa-liphutheloana-tlosa
Hokela sesebelisoa mochining o hole
Sesebelisoa se hoketsoe mochining o hole, 'me setshelo sa Qualcomm TFLite SDK ha se khone ho fihlella sesebelisoa ka USB/ad b.
Setšoantšo se bontša stage ka tatellano ea ts'ebetso ea Qualcomm TFLite SDK:
Etsa litaelo tse latelang ka har'a tflite-tools ho kopitsa lintho tsa khale mochining o hole.
ho latela molaoli oa sephutheloana sesebelisoa:
$ tflite-tools-remote-sync-ipk-rel-pkg
HLOKOMELA Lintlha tse mabapi le mochini o hole li fanoe ho litlhophiso tsa JSON file.
Kenya li-artifacts bakeng sa sethala sa Windows
Lisebelisoa tsa Qualcomm TFLite SDK li ka kenngoa ho sesebelisoa ho latela mokhoa oa ho sebetsa oa mochine o hole.
Bakeng sa sethala sa Windows, etsa se latelang:
Ho PowerShell, sebelisa mongolo o latelang: PS C:
> adb root PS C:> adb disable-verity PS C:> adb reboot PS C:> adb wait-for-device PS C:> adb root PS C:> adb remount PS C:> adb shell mount -o remount, rw / PS C:> adb shell “mkdir -p /tmp” PS C:> adb push /tmp Haeba sephutheloana ke ipk (bakeng sa QCS8550.LE.1.0), sebelisa litaelo tse latelang: PS C:> adb shell “ opkg -force-depends -force-reinstall -force-overwrite install /tmp/”
Kenya li-artifacts bakeng sa sethala sa Linux
Sebelisa litaelo tse latelang:
$ adb motso $ adb disable-verity $ adb reboot $ adb emela-bakeng sa sesebelisoa $ adb motso $ adb remount $ adb shell mount -o remount,rw / $ adb shell "mkdir -p /tmp" $ adb push /tmp Haeba sephutheloana ke ipk (bakeng sa QCS8550.LE.1.0): $ adb shell "opkg -force-depends -force-reinstall -force-overwrite install /tmp/"
Hloekisa setšoantšo sa docker
Ka mor'a ho qeta mosebetsi oa moqapi, tikoloho ea docker e lokela ho hloekisoa ho lokolla polokelo ho disk. Ho hloekisa docker ho tlosa lijana le litšoantšo tse sa sebelisoeng, ka hona ho lokolla sebaka sa disk.
Sebelisa litaelo tse latelang ho hloekisa setšoantšo sa docker:
- Etsa taelo e latelang sebakeng sa mosebetsi sa Linux:
$ cd /tflite-tools - Emisa setshelo:
$ tflite-tools-host-stop-container ./targets/ le-tflite-tools-builder.json - Tlosa setshelo:
$ tflite-tools-host-rm-container ./targets/ le-tflite-tools-builder.json - Tlosa litšoantšo tsa khale tsa docker:
$ tflite-thulusi-host-litšoantšo-hloekiso
Rarolla bothata ba ho seta docker
Haeba taelo ea tflite-tools-host-build-image e khutlisa Nospace e setseng molaetseng oa sesebelisoa, ebe u tsamaisa bukana ea docker ho/local/mnt. Etsa se latelang ho rarolla bothata:
- Etsa bonnete ba docker e teng files:
$ tar -zcC /var/lib docker > /mnt/pd0/var_lib_docker-backup-$(letsatsi + %s).tar.gz - Emisa boema-kepe:
$ tšebeletso ea docker setopong - Netefatsa hore ha ho na ts'ebetso ea docker e sebetsang:
$ ps faux | grep docker - Lekola sebopeho sa directory sa docker:
$ sudo ls /var/lib/docker/ - Tsamaisa buka ea li-docker karolong e ncha:
$ mv /var/lib/docker /local/mnt/docker - Etsa symlink ho directory ea docker karolong e ncha:
$ ln -s /local/mnt/docker /var/lib/docker - Netefatsa hore sebopeho sa "docker directory" se lula se sa fetohe:
$ sudo ls /var/lib/docker/ - Qala docker:
$ tšebeletso ea docker e qala - Qala bocha lijana tsohle ka mor'a hore u tsamaise buka ea docker.
Hlahisa TFLite SDK ka Linux workstation
Ts'ebetso ea TFLite SDK e ka nolofalloa ntle le lijana ho sebelisa setsi sa mosebetsi sa Linux. Mokhoa ona ke mokhoa o mong oa ho sebelisa lijana.
Ho hokahanya le ho aha Qualcomm TFLite SDK, etsa se latelang:
- Theha directory ho moamoheli file mokhoa oa ho hokahanya sebaka sa mosebetsi sa Qualcomm TFLite SDK. Bakeng sa mohlalaampLe:
$mkdir
$cd - Fumana khoutu ea mohloli oa Qualcomm TFLite SDK ho CodeLinaro:
$ repo init -u https://git.codelinaro.org/clo/le/sdktflite/tflite/ manifest.git -repo-branch=qc/stable -repo-url=git://git.quicinc.com/ tools/repo.git -m TFLITE.SDK.1.0.r1-00200-TFLITE.0.xml -b lokolla && repo sync -qc -no-tags -j8 && sync repo -qc -no-tags -j8 - 3. Fetola sebopeho sa JSON file teng ka /tflite-tools/ targets/le-tflite-tools-builder.json e nang le lintlha tse latelang
“Setšoantšo”: “tflite-tools-builder”, “Device_OS”: “le”, “Additional_tag”: “”, “TFLite_Version”: “2.11.1”, “Delegates”: {“Hexagon_delegate”: “OFF”, “Gpu_delegate”: “ON”, “Xnnpack_delegate”: “ON” }, “TFLite_rsync_destination”: “ ”, “SDK_path”: “/build-qti-distro-fullstack-perf/tmpglibc/deploy/sdk>”, “SDK_shell_file”: “”, “Base_Dir_Location”: “”
Bakeng sa tlhaiso-leseling e batsi ka likenyo tse boletsoeng ho json configuration file, bona Docker.md readme file ho /tflite-tools/.
HLOKOMELA Bakeng sa QCS8550, moemeli oa Hexagon DSP ha a tšehetsoe - Fumana mongolo ho theha tikoloho:
$ cd /tflite-tools
$ mohloli ./scripts/host/host_env_setup.sh - Haha Qualcomm TFLite SDK.
$ tflite-tools-setup targets/le-tflite-tools-builder.json - Sebelisa litaelo tse latelang ka har'a khetla e tšoanang ea Linux ho bokella lintho tsa khale tsa TFLite SDK
TFLite_rsync_destination.
$ tflite-tools-host-get-rel-package targets/le-tflite-tools-builder.json
$ tflite-tools-host-get-dev-package targets/le-tflite-tools-builder.json - Kenya li-artifacts ho latela sistimi e sebetsang
- Bakeng sa sethala sa Windows, ho PowerShell, sebelisa sengoloa se latelang
PS C:> adb motso PS C:> adb disable-verity PS C:> adb reboot PS C:> adb emetse-bakeng sa sesebelisoa PS C:> adb motso PS C:> adb remount PS C:> adb shell mount - o remount,rw / PS C:> khetla ea adb "mkdir -p / tmp" PS C:> adb push /tmp
Haeba sephutheloana e le ipk (bakeng sa QCS8550.LE.1.0), sebelisa litaelo tse latelang:
PS C:> khetla ea adb "opkg -force-depends -force-reinstall -forceoverwrite kenya /tmp/
Bakeng sa sethala sa Linux, sebelisa script e latelang:
$ adb motso $ adb disable-verity $ adb reboot $ adb emela-bakeng sa sesebelisoa $ adb motso $ adb remount $ adb shell mount -o remount,rw / $ adb shell "mkdir -p /tmp" $ adb push /tmp Haeba sephutheloana ke ipk (bakeng sa QCS8550.LE.1.0):
$ adb shell "opkg -force-depends -force-reinstall -force-overwrite install /tmp/"
- Bakeng sa sethala sa Windows, ho PowerShell, sebelisa sengoloa se latelang
Hlahisa lintho tsa khale tsa Qualcomm TFLite SDK bakeng sa moaho oa QIM SDK
Ho sebelisa lintho tsa khale tse hlahisitsoeng ho thusa plug-in ea Qualcomm TFLite SDK GStreamer ho QIM SDK, etsa se latelang:
- Qetella tšebetso ho Sync 'me u hahe Qualcomm TFLite SDK, ebe u tsamaisa taelo e latelang: $ tflite-tools-host-get-dev-tar-package ./targets/le-tflite-toolsbuilder.json
A tar file e hlahisoa. E na le Qualcomm TFLite SDK tseleng e fanoeng ho "TFLite_rsync_destination" - Ho nolofalletsa plug-in ea Qualcomm TFLite SDK GStreamer, sebelisa tar file joalo ka khang ho tlhophiso ea JSON file bakeng sa moaho oa QIM SDK.
Ho fumana leseli mabapi le ho hlophisa QIM SDK, sheba Qualcomm Intelligent Multimedia SDK (QIM SDK) Tataiso ea ho Qala ka Potlako (80-50450-51).
Haha Qualcomm TFLite SDK butle-butle
Haeba u ntse u haha Qualcomm TFLite SDK ka lekhetlo la pele, bona Haha lisebelisoa tsa Qualcomm TFLite SDK - developer workflow. Tikoloho e tšoanang ea kaho e ka sebelisoa hape bakeng sa nts'etsopele e ntseng e eketseha.
Lisebelisoa tsa mothusi (ka har'a setshelo) tse boletsoeng setšoantšong li fumaneha ho batho ba ntlafatsang ho bokella lits'ebetso tse fetotsoeng le li-plug-ins.
Setšoantšo sa 5-1 Phallo ea mosebetsi ka har'a setshelo
Kamora hore liphetoho tsa khoutu li phetheloe bukeng ea khoutu, etsa se latelang:
- Kopanya khoutu e fetotsoeng:
$ tflite-tools-keketso-build-install - Khoutu e hlophisitsoeng ea sephutheloana:
$ tflite-tools-ipk-rel-pkg kapa $ tflite-tools-deb-rel-pkg - Khokahanya liphutheloana tsa tokollo le moamoheli file tsamaiso:
$ tflite-tools-remote-sync-ipk-rel-pkg
Or
$ tflite-tools-remote-sync-deb-rel-pkg - Lokisetsa sephutheloana sa dev:
$ tflite-thulusi-ipk-dev-pkg
Lintho tse entsoeng ka matsoho li fumaneha ho sephutheli sa TFLite_rsync_destination se boletsoeng ho JSON. file, e ka kopitsoang bukeng efe kapa efe.
Sebetsa le QNN kantle ho TFLite Moemeli
TFLite External Delegate e o lumella ho tsamaisa mehlala ea hau (karolo kapa e felletseng) ho moahloli e mong o sebelisa lilaebrari tse fanoeng ke motho oa boraro ea tšepahalang joalo ka QNN ka Qualcomm. Mochini ona o ka phahamisa mefuta e fapaneng ea li-accelerator tse fumanehang sesebelisoa joalo ka GPU kapa Hexagon Tensor processor (HTP) bakeng sa boithuto. Sena se fa batho ba ntlafatsang mokhoa o feto-fetohang le o arohaneng ho tloha ho TFLite ea kamehla ho potlakisa maikutlo.
Lintho tse hlokahalang:
- Netefatsa hore o sebelisa setsi sa ho sebetsa sa Ubuntu ho ntša stack ea QNN AI.
- Netefatsa hore o sebelisa mofuta oa QNN 2.14 ho sebelisana le Qualcomm TFLite SDK
Qualcomm TFLite SDK e nolofalitsoe ho etsa liqeto ho likarolo tse 'maloa tsa QNN ka TFLite Moemeli oa kantle oa QNN. Mefuta ea TFLite e nang le boemeli bo tloaelehileng ba flatbuffer e ka tsamaisoa ho GPU le HTP.
Kamora hore liphutheloana tsa Qualcomm TFLite SDK li kenngoe sesebelisoa, etsa se latelang ho kenya lilaebrari tsa QNN sesebelisoa.
- Khoasolla Qualcomm Package Manager 3 bakeng sa Ubuntu.
a. Tobetsahttps://qpm.qualcomm.com/, ebe o tobetsa Lisebelisoa.
b. Fenstereng e ka ho le letšehali, tšimong ea Lisebelisoa tsa ho Batla, tlanya QPM. Ho tsoa lethathamong la System OS, khetha Linux.
Liphetho tsa lipatlisiso li bonts'a lethathamo la Batsamaisi ba Pakete ea Qualcomm.
c. Khetha Qualcomm Package Manager 3 'me u khoasolle sephutheloana sa Linux debian. - Kenya Qualcomm Package Manager 3 bakeng sa Linux. Sebelisa taelo e latelang:
$ dpkg -i - qobella-overwrite /path/to/
QualcommPackageManager3.3.0.83.1.Linux-x86.deb - Khoasolla Qualcomm®
AI Engine Direct SDK sebakeng sa mosebetsi sa Ubuntu.
a. Tobetsa https://qpm.qualcomm.com/ ebe o tobetsa Lisebelisoa.
b. Fenstereng e ka ho le letšehali, tšimong ea Lisebelisoa tsa ho Batla, tlanya AI stack. Ho tsoa lethathamong la System OS, khetha Linux.
A Lenane la ho theoha le nang le lienjineri tse fapaneng tsa AI lia hlaha.
c. Tobetsa Qualcomm® AI Engine Direct SDK ebe u khoasolla sephutheloana sa Linux v2.14.0. - Kenya Qualcomm® AI Engine Direct SDK sebakeng sa mosebetsi sa Ubuntu.
a. Kenya laesense tshebetsong:
qpm-cli -license-activate qualcomm_ai_engine_direct
b Kenya AI Engine Direct SDK:
$ qpm-cli -extract /path/to/ qualcomm_ai_engine_direct.2.14.0.230828.Linux-AnyCPU.qik - Sutumelletsa lilaebrari ho sesebelisoa ho tloha setsing sa mosebetsi sa Ubuntu ka adb push.
$ cd /opt/qcom/aistack/qnn/2.14.0.230828 $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnDsp.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnDspV66Stub.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnGpu.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnHtpPrepare.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnHtp.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnHtpV68Stub.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnSaver.so /usr/lib/ $ adb push ./lib/aarch64-oe- linux-gcc11.2/ libQnnSystem.so /usr/lib/ $ adb push ./lib/aarch64-oe-linux-gcc11.2/ libQnnTFLiteDelegate.so /usr/lib/ $ adb push ./lib/hexagon-v65/ unsigned/ libQnnDspV65Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v66/unsigned/ libQnnDspV66Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexaunsign-v68/ libQnnHtpV68Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v69/unsigned/ libQnnHtpV69Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-v73/unsigned/ libQnnHtpV73Skel.so /usr/lib/rfsa/adsp $ adb push ./lib/hexagon-vXNUMX/unsigned/libQnnHtpVXNUMXSkel. kahoo /usr/lib/rfsa/adsp
Lekola Qualcomm TFLite SDK
Qualcomm TFLite SDK e fana ka example lits'ebetso, tse ka sebelisetsoang ho netefatsa, ho lekanya, le ho fumana bonnete ba mefuta eo mohlahlami a batlang ho e hlahloba.
Ka mor'a hore liphutheloana tsa Qualcomm TFLite SDK li kenngoe mochine, nako ea ho sebetsa e fumaneha sesebelisoa ho tsamaisa tsena tsa khale.ample likopo.
Tlhokahalo
Etsa li-directory tse latelang sesebelisoa:
$ adb shell "mkdir / data / Models"
$ adb shell "mkdir / data/Lables"
$ adb shell "mkdir / data/profiling"
Label setšoantšo
Setšoantšo sa leibole ke sesebelisoa se fanoeng ke Qualcomm TFLite SDK se bonts'ang hore na u ka kenya mofuta oa TensorFlow Lite o koetlisitsoeng pele le o fetotsoeng 'me oa o sebelisa ho lemoha lintho tse litšoantšong. Lintho tse hlokahalang:
Khoasolla sampmohlala le setšoantšo:
U ka sebelisa mofuta ofe kapa ofe o lumellanang, empa mofuta o latelang oa MobileNet v1 o fana ka pontšo e ntle ea mohlala o koetliselitsoeng ho lemoha lintho tse 1000 tse fapaneng.
- Fumana mohlala
$ curl https://storage.googleapis.com/download.tensorflow.org/models/ mobilenet_v1_2018_02_22/mobilenet_v1_1.0_224.tgz | tar xzv -C / data $ mv /data/mobilenet_v1_1.0_224.tflite /data/Models/ - Fumana li-label
$ curl https://storage.googleapis.com/download.tensorflow.org/models/ mobilenet_v1_1.0_224_frozen.tgz | tar xzv -C /data mobilenet_v1_1.0_224/ labels.txt
$ mv /data/mobilenet_v1_1.0_224/labels.txt /data/Labels/
Kamora hore o hokahane le setshelo sa docker sa Qualcomm TFLite SDK, setšoantšo se ka fumanoa ho:
"/mnt/tflite/src/tensorflow/tensorflow/lite/examples/label_image/ testdata/grace_hopper.bmp”
a. Sututsa sena file ho/data/Labels/
b. Etsa taelo:
$ adb shell "label_image -l /data/Labels/labels.txt -i /data/Labels/ grace_hopper.bmp -m /data/Models/mobilenet_v1_1.0_224.tflite -c 10 -j 1 -p 1"
Benchmark
Qualcomm TFLite SDK e fana ka sesebelisoa sa ho lekanya ts'ebetso ea linako tse fapaneng tsa ho matha.
Lisebelisoa tsena tsa benchmark hajoale li lekanya le ho bala lipalo-palo bakeng sa metrics ea bohlokoa e latelang:
- Nako ea ho qala
- Inference nako ea boemo ba ho futhumala
- Inference nako ea boemo bo tsitsitseng
- Tšebeliso ea memori nakong ea ho qala
- Tšebeliso ea memori ka kakaretso
Lintho tse hlokahalang
Sututsa mefuta e tla lekoa ho tsoa ho TFLite Model Zoo (https://thub.dev/) ho/data/Mehlala/. Matha le mangolo a latelang:
- Pakete ea XNN
$ adb shell "benchmark_model -graph=/data/Models/ - enable_op_profiling=nete -use_xnnpack=nete -num_threads=4 -max_secs=300 -profiling_output_csv_file=/data/profiling/” - Moemeli oa GPU
$ adb shell “benchmark_model –graph=/data/Models/ — enable_op_profiling=nete –use_gpu=true –num_runs=100 –warmup_runs=10 — max_secs=300 –profiling_output_csv_file=/data/profiling/” - Moemeli oa Kantle
QNN Moemeli oa Kantle oa GPU:
Matha maikutlo ka mohlala oa ntlha e phaphametseng:
$ adb shell-taelo “benchmark_model –graph=/data/Models/ .tflite –external_delegate_path=libQnnTFLiteDelegate.so — external_delegate_options='backend_type:gpu;library_path:/usr/lib/ libQnnGpu.us/braryskerdir_brary: /adsp'”
QNN HTP ea moemeli oa kantle:
Etsa tlhahiso-leseling ka mofuta oa quant:
$ adb shell-command “benchmark_model –graph=/data/Models/ .tflite –external_delegate_path=libQnnTFLiteDelegate.so — external_delegate_options='backend_type:htp;library_path:/usr/lib/ libQnnHtp_brarysker/librr; /adsp'”
Sesebelisoa sa ho nepahala
Qualcomm TFLite SDK e fana ka sesebelisoa sa ho nepahala ho bala ho nepahala ha mefuta e nang le linako tse fapaneng tsa ho matha.
- Ho hlophisoa le moemeli oa GPU
Mehato ea ho thowuni e hlokahalang files ho hlahlojoa e ka fumanoa ho: "/mnt/tflite/src/tensorflow/tensorflow/lite/tools/evaluation/tasks/ imagenet_image_classificatio/README.md"
The binary bakeng sa ho tsamaisa sesebelisoa sena e se e le karolo ea SDK, kahoo moqapi ha a hloke ho e haha hape.
$ adb shell "image_classify_run_eval - model_file=/data/Mehlala/ –ground_truth_images_path=/data/ — ground_truth_labels=/data/ -model_output_labels=/ data/ -delegate=gpu” - Ho fumana ntho ka XNN pack
$ adb shell "inf_diff_run_eval -model_file=/data/Mehlala/ -delegate=xnnpac
TSEBISO MOLAO
Ho fihlella le ho sebelisa tokomane ena, hammoho le lintlha life kapa life, boto ea litšupiso files, litšoantšo, tlhahlobo le lintlha tse ling tse teng mona (ka kakaretso sena "Litokomane"), e ipapisitse le uena (ho kenyeletsoa le mokhatlo kapa setheo se seng sa molao seo u se emelang, ka kopanelo "Uena" kapa "Hao") kamohelo ya dipehelo le dipehelo ("Lipehelo tsa tšebeliso") e behiloeng ka tlase. Haeba u sa lumellane le Melao ena ea Tšebeliso, u ka 'na ua se ke ua sebelisa Tokomane ena' me hang-hang u tla senya kopi leha e le efe ea eona.
- Tsebiso ea Molao.
Tokomane ena e etsoa hore e fumanehe ho Uena feela bakeng sa tšebeliso ea Hao ea ka hare ka lihlahisoa tseo le linyehelo tsa litšebeletso tsa Qualcomm Technologies, Inc. (“Qualcomm Technologies”) le mekhatlo e amanang le eona e hlalositsoeng Tokomaneng ena, 'me e ke ke ea sebelisetsoa merero efe kapa efe. Tokomane ena e ka 'na ea se ke ea fetoloa, ea lokisoa, kapa ea lokisoa ka tsela efe kapa efe ntle le tumello e ngotsoeng ea pele ea Qualcomm Technologies. Tšebeliso e sa lumelloeng kapa phatlalatso ea sena
Litokomane kapa tlhahisoleseling e fanoeng mona e thibetsoe ka thata, 'me U lumela ho lefa Qualcomm Technologies, balekane ba eona le ba fanang ka laesense bakeng sa ts'enyehelo kapa tahlehelo efe kapa efe e bakiloeng ke Qualcomm Technologies, balekane ba eona le ba fanang ka laesense bakeng sa ts'ebeliso efe kapa efe e sa lumelloeng kapa liphatlalatso tsa Tokomane ena kaofela. karolo. Qualcomm Technologies, balekane ba eona le ba fanang ka laesense ba boloka litokelo tsohle le botho ka har'a Tokomane ena. Ha ho laesense ea lets'oao lefe kapa lefe, tokelo ea molao, litokelo tsa molao, tokelo ea ts'ireletso ea mask kapa tokelo efe kapa efe ea thepa ea mahlale e fanoeng kapa e hlahisoa ke Tokomane ena kapa tlhahisoleseling efe kapa efe e hlahisitsoeng mona, ho kenyeletsoa, empa ha e felle feela, laesense efe kapa efe ea ho etsa, ho sebelisa, ho tlisa kapa rekisa sehlahiswa sefe kapa sefe, tshebeletso kapa thekenoloji e fanang ka tlhahisoleseding efe kapa efe e leng Tokomaneng ena.
TOKOMANE ENA E FUMANA “JOALOKAHA” KA NTLE HO TIISETSO EA MOFUTA OFE KAPA EFE, E KA BA E HLAHISITSOE, E BONAHALA, E MOLAO KAPA HANG. HO FIHLELA HO FIHLELA HO DUMELLA KE MOLAO, LITHEKNOLOJI TSA QUALCOMM, BATHO BA EONA LE BA LASESENSE BA HLOKOMELA KA HO KHETHEHILENG LITIISETSO TSOHLE TSA SEHLOOHO, HO HLOKAHALA HO HLOKAHALA, HO FIHLELA MOSEBETSI OA KHETHEHILENG, TSELA E KHETHEHILENG. LITEKISO TSOHLE TSE TSOANG KA HO SEBELISA KHOEBO KAPA HO TSOA MOKHOA OA HO SEBELISANA KAPA MOKHOA OA HO SEBETSA. HO FETA HO FETA, HA HO QUALCOMM TECHNOLOGIES, HONA BATHO BA E MANG KAPA BA LASESENSI, BA TLA BA MORATO HO WENA KAPA MOTHO O MANG LE MANG WA BORARO BAKENG SA LITJEHO, TAHLEHELO, TŠEBELISO, KAPA LIKETSO KAMOO E KA ETSANG KAPA TLALEHONG ENA.
Lisebelisoa tse ling tsa lihlahisoa, lisebelisoa le lisebelisoa tse boletsoeng Tokomaneng ena li ka 'na tsa hloka hore U amohele lipehelo le lipehelo tse ling pele u sebelisa kapa u sebelisa lintho tseo.
Lintlha tsa tekheniki tse boletsoeng Tokomaneng ena li ka ipapisa le US le melao e meng e sebetsang ea taolo ea thomelontle. Phetiso e khahlano le US le melao efe kapa efe e sebetsang e thibetsoe ka thata.
Ha ho letho ho Tokomane ena e leng tlhahiso ea ho rekisa likarolo kapa lisebelisoa tse boletsoeng mona.
Litokomane tsena li ka fetoha ntle le tsebiso e 'ngoe. Ha ho na le khohlano lipakeng tsa Melaoana ena ea Tšebeliso le ea Website Terms of Use on www.qualcomm.com kapa Leano la Lekunutu la Qualcomm le boletsoeng ho www.qualcomm.com, Melaoana ena ea Tšebeliso e tla laola. Ha ho na le khohlano lipakeng tsa Melaoana ena ea Tšebeliso le tumellano efe kapa efe (e ngotsoeng kapa e tobetse) e entsoeng ke Uena le Qualcomm Technologies kapa Qualcomm Technologies e amanang le phihlello ea hau ea ho sebelisa le ho sebelisa Tokomane ena, tumellano e 'ngoe e tla laola. .
Melaoana ena ea Tšebeliso e tla laoloa le ho hlalosoa le ho sebelisoa ho ea ka melao ea Naha ea California, ho sa kenyeletsoe Tumellano ea Machaba a Kopaneng ea Thekiso ea Thepa ea Machabeng, ho sa natsoe melaoana ea likhohlano. Khang efe kapa efe, tleleime kapa phehisano efe kapa efe e hlahang kapa e amanang le Melaoana ena ea Tšebeliso, kapa tlōlo ea molao kapa bonnete ba eona, e tla ahloloa feela ke lekhotla le nang le matla a taolo seterekeng sa San Diego, State of California, 'me ka hona o lumela ho matla a botho a makhotla a joalo bakeng sa morero oo. - Litlaleho tsa Letšoao la Khoebo le Sehlahisoa.
Qualcomm ke letshwao la kgwebo kapa letshwao la kgwebo le ngodisitsweng la Qualcomm Incorporated. Arm ke lets'oao la khoebo le ngolisitsoeng la Arm Limited (kapa liofisiri tsa eona) Amerika le/kapa libakeng tse ling. Letshwao la lentswe la Bluetooth® ke letshwao la kgwebo le ngodisitsweng la Bluetooth SIG, Inc. Mabitso a mang a dihlahiswa le mabitso a hlahang Tokomaneng ena e ka ba matshwao a kgwebo kapa matshwao a kgwebo a ngodisitsweng a beng ba ona.
Lihlahisoa tse tsebahalang tsa Snapdragon le Qualcomm tse boletsoeng ho Tokomane ena ke lihlahisoa tsa Qualcomm Technologies, Inc. le/kapa lithuso tsa eona. Litheknoloji tse nang le patente ea Qualcomm li ngolisitsoe laesense ke Qualcomm Incorporated.
Litokomane / Lisebelisoa
 |
Qualcomm TensorFlow Lite SDK Software [pdf] Bukana ea Mosebelisi TensorFlow Lite SDK Software, Lite SDK Software, SDK Software, Software |
