Integration guidance for the OpenExplorer command-line toolchain, which converts and prepares machine-learning models for supported hardware. It covers configuration, compilation, quantization, accuracy checks, performance analysis, and deployment.
Instructions for running many machine-learning model quantization experiments and comparing their results. Quantization reduces the numerical precision used by a model, which can make it smaller or faster but may affect accuracy.
A workflow for running LightCompress model-quantization experiments and producing accuracy reports. Quantization reduces the numerical precision used by a machine-learning model to explore smaller or faster versions.
A development workflow for adding support for a new language or vision-language model to the llmcompression framework. It compares the model with an existing implementation or with the Transformers source code before integration.
Um guia para as operações diárias da ferramenta llm_compression, usada para calibrar, avaliar, compilar e executar modelos de linguagem em placas. Um modelo de linguagem é um sistema de aprendizagem automática que processa e gera texto.
An orchestration guide for adapting a floating-point PyTorch model to Horizon Robotics' quantization toolkit, horizon_plugin_pytorch. Quantization changes a model so it can use lower-precision numbers, and QAT means quantization-aware training.
A guide for adding dynamic-block markers when adapting PyTorch models for Horizon Robotics' quantization toolkit. Dynamic control flow means loops or branches whose execution changes with the input, random values, or external state.
A code-editing guide for adding deployment-boundary markers to floating-point PyTorch models. It places separate QuantStub and DeQuantStub modules around the part of the model that will be quantized by Horizon's tools.
A code-editing guide for preparing floating-point PyTorch models for Horizon's quantization-aware training tools. It adds the required prepare call and uses a fixed configuration for double-int8 operations.
A coding guide for choosing the fake-quantization state of a model in Horizon's PyTorch quantization workflow. Fake quantization simulates reduced-precision calculations so a model can be prepared for quantized deployment.
A troubleshooting procedure for finding where a Horizon QAT PyTorch model loses accuracy between training and hardware deployment. It compares the model and outputs at stages from the trained file through conversion, compilation, and the device.
A procedure for creating a separate script that exports a Horizon QAT PyTorch model into HBIR, an intermediate format used for later compilation and deployment. QAT means quantization-aware training, where a model is trained to account for reduced-precision calculations.
A tool for comparing two PyTorch FX Graph files, which describe the operations in a machine-learning model, and linking differences back to model source code.
A code-generation workflow for quantizing and compiling neural-network models for Horizon hardware. Quantization reduces numerical precision so models can be prepared for deployment.
Um gerador de código que transforma um modelo já quantizado num ficheiro HBM compilado para implantação em hardware Horizon. HBM é o formato de modelo usado pelo processo de compilação para execução no dispositivo.
Um gerador de código para preparar modelos de aprendizagem automática para quantização no hardware Horizon J6. Quantização reduz a precisão numérica do modelo para permitir a execução no dispositivo; QAT significa treino consciente da quantização.
A guide for reading Horizon model-check results after preparing a model for quantization, a process that makes models use lower-precision numbers. It examines model structure and quantization settings using model_check_result.txt.
A guide for fixing accuracy problems in PyTorch models on Horizon J6 hardware before deployment. It focuses on calibration and quantization-aware training, where model numbers are adapted for faster, lower-precision processing.
A routing entry point for Horizon J6 development tasks. It sends requests to focused tools for model performance tests, HBM inference deployment, inference code generation, and Perfetto trace analysis.
A tool for measuring a J6 development board’s processor load, DDR memory bandwidth, and memory use over SSH. It can collect these readings while computer-vision or language models run, or while the board is idle.
Generate X86-side Python client code for hbminfer, the Python SDK that connects to BPU boards via gRPC to deploy and run HBM model inference. Use this skill when the user wants to write Python code using hbminfer client APIs — including HbmRpcSession (standard/flexible mode), HTensor for transmission optimization…
A guide for generating C++ code for UCP-based neural-network inference, the process of running a trained model to produce predictions. It covers loading a .hbm model, preparing tensors, processing input, running inference, reading outputs, and releasing resources.
A repository instruction file for generating software assets such as logos, icons, favicons, illustrations, and hero images. It describes available generation routes and how to handle requests without an image API key.
17 2mo agoE70 tokens
originalApache-2.0
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: