A demonstration of a form of assisstive technology experiment I pulled off on my Samsung device:
This relates to running completely offline A.I. based image recognition on your android handset, using a side-loaded package.
Besides it's own interface it offers a form of plugin for either tasker or macro droid android automation software packages, and it specifically offers forms of image recognition functionality.
In it's settings section, you can provide it with API keys for online providers, or else the option I adopted here was to download an instance of google's gemma4 model onto my own handset(2.4GB).
I then set up a macro droid macro which takes a snapshot using the built-in back camera, saving it under /pictures/macros path, and the macro then scans that path, pulls a list of files and then passes the newest file path through to the plugin, waits 5 seconds and then uses text-to-speech to read out the results that the plugin has stored in a macro-local-variable.
and there you go!
Links to relevant URLs, including a link to the macro are in the video description.
--
Jacob Kruger
"Resistance is futile...acceptance is versatile..."
This relates to running completely offline A.I. based image recognition on your android handset, using a side-loaded package.
Besides it's own interface it offers a form of plugin for either tasker or macro droid android automation software packages, and it specifically offers forms of image recognition functionality.
In it's settings section, you can provide it with API keys for online providers, or else the option I adopted here was to download an instance of google's gemma4 model onto my own handset(2.4GB).
I then set up a macro droid macro which takes a snapshot using the built-in back camera, saving it under /pictures/macros path, and the macro then scans that path, pulls a list of files and then passes the newest file path through to the plugin, waits 5 seconds and then uses text-to-speech to read out the results that the plugin has stored in a macro-local-variable.
and there you go!
Links to relevant URLs, including a link to the macro are in the video description.
--
Jacob Kruger
"Resistance is futile...acceptance is versatile..."
