Basler AI Vision Solution Kit with Cloud Connectivity YOUR STARTING POINT FOR THE NEXT GENERATION OF SMART VISION-BASED IOT EDGE DEVICES Vision based. Smart. Connected. Powerful. Ready to use. AI Vision Solution Kit by Basler Powered by The Internet of Things (IoT) and the many options for product enhancement that it provides are no longer a new phenom- enon. Yet, developers still face significant challenges when being confronted with the development of new, vision based IoT tasks such as object or people detection, and others. First, they need to define all components needed to set up a system: 1. Data acquisition: A data stream of images, generated by a camera 2. Data processing: Powerful hardware to process image data 3. Data analytics: A Machine Learning algorithm needed to perform the inference and 4. Connectivity: Ability to use cloud services and send meta data to the cloud (data storage, analytics). Secondly, all these parts have to fit together and operate seamlessly. Again, this requires extensive expert know- ledge. Out of one hand, Basler oeff rs the complete expertise needed to start developing an IoT vision system: With its AI Vision Solution Kit all necessary hard- and software components are integrated into a ready-to-use prototyping kit. 1. Data Acquisition: e.g. Images Camera Basler New IoT AI Vision Challenge 1 Challenge 2 Vision Task Solution Kit 2. Data Processing: Required Required Processing Performant Hardware Components Expertise Examples: Development Board Kit with inte- Which com- How can a Object grated hard- 3. Data Analytics: ponents are working system Detection and software ML Algorithm for Inference needed to set be set up ML Model architecture People up a system easily to prototype Detection 4. Connectivity: vision task. e.g. Data Storage, Cloud Visualization of Results Service The AI Vision Solution Kit is Baslers answer to solve heterogeneous hard- and software landscapes when dealing with the prototyping of new IoT vision tasks. 1 BASLER AI VISION SOLUTION KIT WITH CLOUD CONNECTIVITYTECHNICAL DETAILS How It Works: The Functionality of the AI Vision Solution Kit with Cloud Connectivity Targeted towards Data Scientists and Field Application In the next step, the compiled ML model available in the Engineers, the AI Vision Solution Kit is an embedded vision Basler cloud is deployed on the kit using container manage- system for easy prototyping of IoT vision solutions. Its inte- ment and AWS SageMaker. grated hard- and software design comprises Baslers newly developed IoT software architecture: Basler Container Man- Moreover, camera parameters can be adjusted using the agement and Cloud Connector. They allow the easy deploy- camera configuration tool. pylon operates and configures ment of optimized ML learning models and access to cloud the camera, a 13 MP Basler dart with BCON for MIPI inter- services. face. In this way, image quality can be adjusted and assured. This is important as the quality of the ML inference on the There are two options for machine learning models used on kit depends not only on the training of the model, but also the system: Either Baslers ML models can be chosen or own on the quality of the acquired data from the camera and on ML models can be uploaded. the power of the processing unit. After the inference is done on the kit, resulting meta data is sent to the AWS cloud and 1. Baslers ML models are pre-trained ML models for object stored using AWS IoT Core. detection and people detection. These Basler ML models are optimized for the SoC and the generated image With the AI Vision Solution Kit, prototyping of IoT vision data: they seamlessly work together. solutions based on embedded technology is taken to the next level. Basler also supports its customers beyond the 2. If developers use their own ML models, they are able to prototyping stage and develops customized solutions based use the functionalities of AWS SageMaker and AWS on its flexible toolbox approach of hard- and software SageMaker Neo to train, optimize and deploy them. components. AWS SageMaker, AWS SageMakerNeo AWS IoT Core Camera Basler ML Model ML Model ML Model optimized for AI Vision Conguration Solution Kit & Live Image (SoC/Vision) Storage Train Optimize Train Optimize Set Camera Parameters Deploy ML Model Send Meta Data Basler IoT Architecture (Container Management and Cloud Connector) Image Processing Camera Image Software Suite Acquisition ML Model Inference AWS Basler 2 BASLER AI VISION SOLUTION KIT WITH CLOUD CONNECTIVITY