nvidia/skills▌
234 approved skills in this repository
omniverse-realtime-viewer
omniverse
Use as the top-level router for Omniverse Realtime Viewer USD app requests and focused viewer reference documents.
nemo-rl-auto-research
nemo
Autonomous NeMo-RL research agent workflow for directed hypothesis testing and open-ended discovery. Guides agents through the full experiment lifecycle: understanding recipes and environments, wiring RL or NeMo-gym runs, launching reproducible baselines and iterations, analyzing results, preserving human oversight, and using git plus TSV logs as the research ledger. Do NOT use for: bug fixes, code review, documentation, refactoring, dependency updates, or single-file changes.
tao-finetune-cosmos-reason
tao
Cosmos3-Nano video QA supervised fine-tuning with FSDP parallelism. Use when training or evaluating video
cuopt-skill-evolution
cuopt
After solving a non-trivial problem, detect generalizable learnings and propose skill updates. Always active — applies to every interaction.
tao-train-depth-anything-v2
tao
Monocular depth estimation using Metric Depth Anything v2 or Relative Depth Anything architectures. Predicts
rag-blueprint
rag
NVIDIA RAG Blueprint — deploy, configure, troubleshoot, and manage. Handles any RAG action: deploy, install, start, enable, disable, toggle, change, configure, troubleshoot, debug, fix, shutdown, stop, or tear down any RAG feature or service (Agentic RAG, VLM, guardrails, query rewriting, models, search, ingestion, observability, summarization, reasoning, and more).
earth2studio-install
earth2studio
>
vss-generate-video-calibration
vss-generation
Use to run AutoMagicCalib on local MP4s, RTSP, or the bundled sample dataset, and to deploy vss-auto-calibration when needed. Do not use for non-AMC calibration or runtime analytics.
vss-summarize-video
vss-summarization
Use to summarize a recorded video via the LVS summarization microservice (HITL-gated) with a VLM fallback. Not for report generation or live RTSP captioning.
vss-deploy-dense-captioning
vss-deployment
Use this skill when deploying standalone RT-VLM dense captioning or calling its REST API (uploads, captions, streams, chat-completions, Kafka). Not for VSS profile deploy or video-search ingestion.
vss-query-analytics
vss-search
Use this skill when reading video-analytics metrics, incidents, alerts, and sensor data via the VA-MCP server (port 9901). Not for live VLM or incident-range narrative reports.
vss-generate-video-report
vss-generation
Use this skill when producing a VSS analysis report — Mode A per-clip VLM, Mode B incident-range via video-analytics. Not for standalone video summarization, real-time alerts or ad-hoc Q&A.
vss-setup-behavior-analytics
vss-setup
Use to deploy the vss-behavior-analytics service standalone (entrypoint, config-source, optional calibration). Not for the full warehouse deploy.
vss-deploy-video-embedding
vss-deployment
Use this skill when deploying, operating, or integrating the VSS 3.2 GA RT-Embed Video Embedding microservice. Covers Docker Compose bring-up, GPU and storage prerequisites, the `/v1` REST API (file uploads, text and video embeddings, live RTSP streams, health and metrics), Redis/Kafka/OTel integration, common failure modes, and teardown.
vss-search-archive
vss-search
Use this skill to run top-level VSS fusion search on archived video, or to ingest video files / RTSP streams for search. Do NOT use for ad-hoc visual Q&A (use vss-ask-video), live captioning (use vss-deploy-dense-captioning), or video summarization and reports (use vss-summarize-video).
vss-ask-video
vss-query
Use this skill to ask the VSS agent's video_understanding tool a fresh visual question about a recorded clip. Not for prior tool output, search hits, or metadata-answerable questions.
vss-manage-alerts
vss-management
Use for VSS alert workflows — real-time monitoring, Alert-Bridge subscriptions, Slack notifications, incident queries, camera onboarding. Not for non-alert analytics.
vss-deploy-profile
vss-deployment
Use to select, configure, deploy, verify, debug, or tear down a VSS profile (base, search, lvs, warehouse, edge). Not for standalone microservices — use the vss-deploy-* skill.
vss-setup-video-analytics-api
vss-setup
Use to deploy the vss-video-analytics-api REST service standalone (config-source, data-log bind, Elasticsearch, optional Kafka). Not for full warehouse deploy.
vss-deploy-detection-tracking-2d
vss-deployment
Use this skill when the user wants to deploy, run, debug, tear down, or call the REST API of the RTVI-CV 2D detection / tracking microservice. Trigger when the user says things like 'deploy rtvi-cv', 'start warehouse 2d', 'add a stream', 'check rtvi-cv health', or 'stop the perception container'. Not for VLM, embedding, or analytics — use the matching vss-* skill.
vss-manage-video-io-storage
vss-management
Use to call the VIOS REST API (sensor list, timelines, clip extraction, snapshots, add/delete sensors and streams). Not for VLM inference or search.
vss-deploy-detection-tracking-3d
vss-deployment
Deploy and operate the RTVI-CV-3D microservice as MV3DT (`MODE=mv3dt`): per-camera DeepStream perception plus BEV Fusion over calibrated cameras. Supports the bundled sample dataset, custom video files, and RTSP streams, and chains to `vss-generate-video-calibration` when calibration is missing. Use `vss-deploy-profile` for the full warehouse blueprint and `vss-deploy-detection-tracking-2d` for single-camera 2D detection.
tao-train-pose-classification
tao
Pose classification using ST-GCN (Spatial Temporal Graph Convolutional Network). Classifies skeleton sequences
tilegym-adding-cutile-kernel
tilegym
Add a new cuTile GPU kernel operator to TileGym. Covers dispatch registration in ops.py, cuTile backend implementation, __init__.py exports, test creation, and benchmark in tests/benchmark. Use when adding, creating, or implementing a new cuTile operator/kernel in TileGym, or when asking how to register a new cuTile op.
tilegym-converting-cutile-to-julia
tilegym
Converts cuTile Python GPU kernels (@ct.kernel) to cuTile.jl Julia equivalents. Handles kernel syntax translation, 0-indexed to 1-indexed conversion, broadcasting differences, memory layout (row-major to column-major), type system mapping, and launch API differences. Use when converting, porting, or translating cuTile Python kernels to Julia cuTile.jl, or debugging/optimizing existing Julia cuTile translations.
tao-train-sparse4d
tao
Sparse4D for multi-camera temporal 3D object detection and tracking. Uses sparse queries with deformable
tao-train-single-step
tao
Standard single-step train/eval/export workflow for any TAO model. Use when training a TAO model on a dataset
tao-validate-dataset-format
tao
Run `tao-daft validate` to check NVIDIA TAO DAFT datasets for structure, schema, and cross-reference errors. Do
tilegym-cutile-python
tilegym
Expert cuTile programming assistant. Write high-performance GPU kernels using cuTile's tile-based programming model with proper validation and optimization. Supports deep agent orchestration for complex multi-kernel tasks.
tilegym-cutile-autotuning
tilegym
Use when adding, modifying, optimizing, or debugging CuTile autotuning code. Trigger signals: `exhaustive_search` / `replace_hints` / `hints_fn` / `cuda.tile.tune` in code, `autotune` in filenames, or correctness/performance issues in autotuned CuTile kernels. Covers: tune-once/cache/launch pattern, per-architecture configs (sm80–sm120), parameter space design (tile sizes, occupancy, num_ctas), and 7 common pitfalls with solutions.
tao-train-oneformer
tao
OneFormer for universal image segmentation. Unifies panoptic, instance, and semantic segmentation with a
tao-train-visual-changenet
tao
Visual ChangeNet for binary image classification and segmentation in AOI defect detection. Use when training,
tao-train-optical-inspection
tao
Optical Inspection for defect detection using Siamese networks. Compares image pairs to detect manufacturing
tao-train-ocrnet
tao
OCRNet for scene text recognition. Recognizes text content from cropped text-region images and supports CTC
tao-train-rtdetr
tao
RT-DETR (Real-Time DEtection TRansformer) for 2D object detection. Designed for real-time inference with
tao-train-reid
tao
Person re-identification (ReID). Learns discriminative embeddings to match the same person across different
tilegym-improve-cutile-kernel-perf
tilegym
Iteratively optimize cuTile kernel performance through systematic profiling, bottleneck analysis, IR comparison, and targeted tuning. Covers tile sizes, occupancy, autotune configs, TMA, latency hints, persistent scheduling, num_ctas, flush_to_zero, and IR-level debugging. Use when asked to "optimize cutile kernel", "improve kernel perf", "tune cutile performance", "make kernel faster", or iteratively benchmark and refine a cuTile GPU kernel in the TileGym project.
tilegym-converting-cutile-to-triton
tilegym
Converts cuTile GPU kernels (@ct.kernel) to Triton (@triton.jit). Handles standard in-repo conversion, debugging (cudaErrorIllegalAddress, shape mismatch, numerical mismatch), and mapping cuTile idioms (ct.load/ct.store, ct.Constant, ct.launch) to Triton equivalents. Covers dual-kernel layout flags (e.g. transpose=True/False + autotune grid via META) per translations/advanced-patterns.md. Use when converting, porting, or translating cuTile kernels to Triton, or debugging existing Triton translations.
tilegym-monkey-patch-kernels-to-transformers
tilegym
Integrate TileGym kernels into Hugging Face `transformers` models by replacing the library's submodule(s) and certain class(es)' implementations, and patching certain class(es)' init/forward/load weight methods prior to instantiating models. Used when the user requires integrating TileGym kernels into `transformers` models.
tao-train-pointpillars
tao
PointPillars for 3D object detection from LiDAR point clouds. Encodes point clouds into a pseudo-image via a
tao-train-segformer
tao
SegFormer for semantic segmentation. Lightweight transformer-based architecture with hierarchical feature
tao-generate-referring-expressions
tao
Four-step image referring-expression pipeline: turns images plus KITTI bounding-box labels into region
tao-train-ocdnet
tao
OCDNet for scene text detection. Detects arbitrary-oriented text regions in natural images using a
tao-convert-dataset-format
tao
Run `tao-daft convert` to convert NVIDIA TAO DAFT datasets between supported formats. Do not use for non-DAFT data.
tao-train-nvpanoptix3d
tao
NVPanoptix3D for panoptic 3D scene reconstruction from posed RGB images. Produces 3D panoptic segmentation
tao-train-nvdinov2
tao
NVDINOv2 for self-supervised visual representation learning. Trains vision transformers via self-distillation
tao-train-metric-learning-recognition
tao
Metric-learning recognition (ml-recog) for fine-grained visual recognition. Learns embeddings for
tao-train-mask2former
tao
Mask2Former for universal image segmentation (panoptic, instance, and semantic). Transformer-based with
tao-train-mask-grounding-dino
tao
Mask Grounding DINO for grounded instance segmentation. Extends Grounding DINO with a mask-prediction head for
tao-train-mask-auto-label
tao
MAL (Mask Auto-Label) for weakly-supervised segmentation. Produces segmentation masks from minimal annotations
tao-generate-image-grounding
tao
Two-step image grounding pipeline: extracts referring expressions from (image, caption) pairs and grounds them
tao-analyze-gaps-vlm-bcq
tao
Extract false-positive and false-negative gaps from VLM binary-classification-question (BCQ, yes/no) predictions.
tao-mine-aoi-images
tao
Runs the DEFT embed-then-mine workflow for VCN AOI iterations — embeds the gap-analysis target parquet, embeds a source pool, and mines nearest-neighbour source images for downstream augmentation. Use as the immediate next step after `tao-route-visual-changenet-samples` when expanding a real-image augmentation queue from the mining subset.
tao-train-fast-foundation-stereo
tao
Real-time stereo depth estimation using FastFoundationStereo (FFS), the distilled bp2 commercial variant of
tao-train-mask-auto-encoder
tao
Masked Auto-Encoder (MAE) for self-supervised pretraining and fine-tuning. Masks random patches and reconstructs
tao-train-image-classification
tao
PyTorch-based TAO image classification. Supports a wide range of backbones (FAN, EfficientNet, ResNet, etc.)
tao-train-grounding-dino
tao
Grounding DINO for open-set object detection. Combines DINO-style detection with a BERT text encoder for
tao-train-foundation-stereo
tao
Stereo depth estimation using FoundationStereo. Predicts disparity maps from stereo image pairs for 3D
tao-finetune-huggingface-model
tao
>
tao-list-capabilities
tao
>-
tao-train-dino
tao
DINO (DETR with Improved DeNoising Anchor Boxes) for 2D object detection. Transformer-based detector with
tao-analyze-gaps-visual-changenet
tao
Performs gap analysis on NVIDIA TAO VCN Classify (Visual Component Net) experiments by invoking the data-services container (`tao_toolkit.data_services` from `versions.yaml`) directly via `docker run … gap_analysis vcn_aoi …` — picks the optimal decision threshold, ranks per-sample weakness, and emits a top-K weakest parquet expanded per-lighting for downstream augmentation. Use when analyzing VCN classification failures, picking SDA augmentation targets, or auditing PASS/NO_PASS boundary cases.
tao-train-deformable-detr
tao
Deformable DETR for 2D object detection. Uses deformable attention for efficient multi-scale feature processing,
tao-train-centerpose
tao
CenterPose for keypoint / pose estimation. Detects object centers and regresses keypoint locations for 6-DoF
tao-train-bevfusion
tao
BEVFusion for multi-sensor 3D object detection. Fuses LiDAR point clouds and camera images in bird's-eye-view
tao-setup-nvidia-gpu-host
tao
>-
tao-launch-workflow
tao
>-
tao-run-on-brev
tao
Brev managed GPU instances with Docker support. Use when running TAO training, evaluation, or inference on
tao-run-platform
tao
TAO Execution SDK for submitting and monitoring GPU training jobs on supported platforms (Brev, SLURM,
tao-analyze-changenet-rca
tao
Performs deep Root Cause Analysis (RCA) on NVIDIA TAO Visual ChangeNet classification experiments with
tao-run-deft-aoi
tao
>
tao-run-inference-service
tao
>
tao-train-action-recognition
tao
Action recognition from video sequences. Supports RGB, optical flow, and joint (multi-stream) input types for
tao-run-automl-deft-pipeline
tao
>
tao-port-huggingface-model
tao
>
rag-eval
rag
>-
physicsnemo-discover
accelerated-computing
Official NVIDIA-authored guidance for navigating PhysicsNeMo — pick the model, datapipe, or example for a SciML/AI4Science task (surrogates, forecasting, downscaling, physics-informed, inverse, generative). Points at existing files via live repo search; never writes code. Do NOT use for installation or environment setup, training-loop or other code authoring/scaffolding, contributor/CI/packaging questions, repo-specific questions in physicsnemo-sym/-cfd/-curator, or general (non-physics) ML/PyTorch.
tao-route-visual-changenet-samples
tao
Routes the weakest VCN samples (output of `tao-analyze-gaps-visual-changenet`) into per-augmentation-module
tao-run-automl
tao
Run AutoML / hyperparameter optimization (HPO) for NVIDIA TAO networks using AutoMLRunner. Handles algorithm
tao-run-on-kubernetes
tao
Kubernetes execution platform — submits TAO container jobs as single-pod k8s Jobs with NVIDIA GPU scheduling.
tao-finetune-cosmos-embed
tao
>-
tao-run-on-lepton
tao
DGX Cloud Lepton managed GPU compute platform with run/status/cancel interface. Use when submitting TAO jobs
tao-finetune-clip
tao
CLIP vision-language model for image-text retrieval, zero-shot classification, embedding extraction, ONNX
tao-run-on-slurm
tao
Remote SLURM GPU cluster execution over SSH with sbatch/srun, Pyxis/Enroot containers, and Lustre-backed
tao-generate-video-reasoning-annotations
tao
>-
tao-run-on-local-docker
tao
Local or remote Docker execution for TAO SDK job containers using a Docker daemon with NVIDIA GPU runtime. Use
skill-card-generator
accelerated-computing
Use only to generate or update a governance skill card for a specified existing agent skill directory. Do not use for explaining, listing, comparing, or discussing skill capabilities.
rag-perf
rag
>-
nemo-mbridge-perf-moe-dispatcher-selection
nemo-mbridge
Choose the right MoE token dispatcher (`alltoall`, DeepEP, or HybridEP) for the hardware, EP degree, and optimization stage. Summarizes patterns from DSV3, Qwen3, Qwen3-Next, and VLM bring-up work.
nemo-mbridge-perf-moe-long-context
nemo-mbridge
Long-context MoE training guidance for Megatron Bridge. Covers CP sizing, selective recompute, dispatcher choices, and practical patterns from DSV3, Qwen3, and Qwen3-Next long-context experiments.
nemo-mbridge-perf-moe-comm-overlap
nemo-mbridge
MoE expert-parallel communication overlap in Megatron Bridge. Covers dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.
nemo-mbridge-perf-moe-hardware-configs
nemo-mbridge
Representative MoE training playbooks by hardware platform and model family. Summarizes rounded throughput bands, parallelism patterns, and common tuning stacks.
physical-ai-video-data-augmentation
physical-ai
>-
physical-ai-neural-reconstruction
physical-ai
Router for NVIDIA NuRec/NRE: USDZ rendering, NCore conversion, 3DGS, gRPC sensor sim, PhysicalAI HF datasets. Do NOT use for SimReady or infra setup.
physical-ai-infrastructure-setup-and-resilient-scaling
physical-ai
>-
nemo-mbridge-recipe-recommender
nemo-mbridge
Recommend and customize Megatron Bridge recipes for a user's model, GPU count, and training goal. Indexes library recipes (pretrain/SFT/PEFT) and performance recipes.
omniverse-usd-performance-tuning
omniverse
Top-level workflow skill for USD performance diagnosis and optimization. Use for slow loading, high memory, low FPS, or 'optimize my scene' requests; delegates auth/runtime setup to Phase 0 owners.
physical-ai-defect-image-generation
physical-ai
>-
omniverse-cad-to-simready
omniverse
Coordinate the end-to-end CAD/source-asset to SimReady workflow. Use for broad requests such as CAD to SimReady, source asset to simulation-ready USD, or prop packaging that require conversion, material/physics assignment, SimReady conformance, validation, and optional package creation; deploy or verify Content Agents services first when property assignment is enabled; route single-stage work through nested references.
nemo-mbridge-perf-tp-dp-comm-overlap
nemo-mbridge
Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.
nv-segment-ctmr
nv-health
Used for running NV-Segment-CTMR on CT or MRI NIfTI volumes and recording label-map evidence. Not for clinical interpretation.
nv-generate-mr-brain
nv-health
Used for generating synthetic brain MRI volumes with NV-Generate-CTMR rflow-mr-brain. Not for production training data.
nv-segment-ct-finetune
nv-health
Used for smoke or dataset finetuning of NV-Segment-CT VISTA3D on CT NIfTI labels. Not for clinical validation.
nemo-rl-docs
nemo
Documentation conventions for NeMo-RL. Covers docs/index.md updates and docstring format. Do NOT use for: bug fixes, test fixes, dependency bumps, refactoring, CI/CD changes, performance tuning, or any task that does not involve writing or updating documentation.
nv-segment-ct
nv-health
Used for running NV-Segment-CT VISTA3D on CT NIfTI volumes and recording label-map evidence.
nv-generate-mr
nv-health
Used for generating synthetic body MRI volumes with NV-Generate-CTMR rflow-mr. Not for paired masks or production training data.
nv-reason-cxr
nv-health
Used for command-shape or live NV-Reason-CXR chest X-ray reasoning smoke tests. Not for diagnosis or clinical reporting.
nemo-mbridge-perf-sequence-packing
nemo-mbridge
Validate and use packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs, and applying the right CP constraints.
nemotron-speech
nemotron
Routes NVIDIA Nemotron Speech (Riva) NIM tasks — deploys, runs, and tests ASR, TTS, and NMT NIMs on build.nvidia.com or self-hosted.
nv-generate-vae-finetune
nv-health
Used for finetuning the NV-Generate-CTMR MAISI VAE from CT/MRI NIfTI datalists. Not for clinical or production data approval.
nemo-rl-brev-etiquette
nemo
Brev instance operating guidance for NeMo-RL agents working in /home/ubuntu/RL with limited workspace disk, a larger /ephemeral volume, and optional /home/ubuntu/RL/.env secrets. Use when running nemo-rl-auto-research campaigns, experiments, training jobs, model or dataset downloads, shared cache-heavy commands, log-producing runs, checkpoint generation, W&B or Hugging Face authenticated workflows, or any workflow that may create large files on Brev.
nv-generate-mr-brain-finetune
nv-health
Used for finetuning NV-Generate-CTMR MR-brain diffusion UNet from a NIfTI datalist. Not for clinical or production data approval.
nemotron-retrieval-recipes
nemotron
Use when planning, debugging, tuning, evaluating, exporting, or deploying public Nemotron `embed`/`rerank` retrieval recipes.
nemoclaw-user-monitor-sandbox
nemoclaw
Inspects sandbox health, traces agent behavior, and diagnoses problems. Use when monitoring a running sandbox, debugging agent issues, or checking sandbox logs. Trigger keywords - monitor nemoclaw sandbox, debug nemoclaw agent issues.
nv-generate-ct-rflow
nv-health
Used for generating synthetic CT volumes and masks with NV-Generate-CTMR rflow-ct. Not for production training data without review.
nemotron-customize
nemotron
Plan, configure, and chain repo-native Nemotron customization steps into single-step or multi-step pipelines: curation, translation, SFT/PEFT (AutoModel or Megatron-Bridge), pretraining/CPT, RL alignment (DPO/RLVR/GRPO/RLHF), BYOB/MCQ benchmarks, checkpoint conversion, ModelOpt optimization, env profiles, and evaluation of trained checkpoints or existing/hosted endpoints. Use when a request names a Nemotron step or workflow, or asks to clean, translate, train, fine-tune, align, convert, optimize, evaluate, or compose these into a pipeline. Do NOT use for frontend/dashboard/visualization work, generic ML advice, billing/access, or non-Nemotron coding tasks.
nemotron-policy-generator
nemotron
Generates BYO custom safety policies for NVIDIA Nemotron content-safety guardrails — Nemotron-Content-Safety-Reasoning-4B (text) and multimodal Nemotron-3-Content-Safety. Produces a Markdown policy, JSON taxonomy, and drop-in inference prompts. Maps rough words or an existing policy to V2 categories, adding custom categories or topic-following rules.
nemoclaw-user-manage-sandboxes
nemoclaw
Explains operational tasks after the quickstart: listing sandboxes, status and health checks, logs, diagnostics, port forwards, multiple sandboxes, credential reset, rebuilds, network presets, upgrades, and uninstall. Trigger keywords - manage nemoclaw sandboxes, nemoclaw status, nemoclaw list, nemoclaw dashboard port, nemoclaw rebuild, nemoclaw upgrade sandboxes, nemoclaw uninstall, sandbox mutability, sandbox runtime configuration, sandbox rebuild, nemoclaw backup, nemoclaw restore, workspace backup, openshell sandbox download upload, nemoclaw messaging channels, nemoclaw telegram, nemoclaw discord, nemoclaw slack, nemoclaw wechat, nemoclaw whatsapp, openshell channel messaging, nemoclaw workspace files, soul.md, user.md, identity.md, agents.md, sandbox persistence.
nemoclaw-user-manage-policy
nemoclaw
Adds, removes, or modifies allowed endpoints in the sandbox policy. Use when customizing network policy, changing egress rules, or configuring sandbox endpoint access. Trigger keywords - customize nemoclaw network policy, sandbox egress policy configuration, nemoclaw integration policy examples, post-install policy setup, openshell approval workflow, policy preset, nemoclaw approve network requests, sandbox egress approval tui.
nemo-mbridge-perf-expert-parallel-overlap
nemo-mbridge
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.
nemoclaw-user-agent-skills
nemoclaw
Describes the agent skills shipped with NemoClaw and how to access them by cloning the repository. Use when users ask about AI agent support, coding assistant integration, or the .agents/skills/ directory. Trigger keywords - nemoclaw agent skills, ai coding assistant, cursor, claude code, copilot.
nemo-mbridge-resiliency
nemo-mbridge
Resiliency features in Megatron Bridge including fault tolerance, straggler detection, in-process restart, preemption, and re-run state machine.
nemo-mbridge-perf-moe-optimization-workflow
nemo-mbridge
Systematic workflow for MoE training optimization in Megatron Bridge, based on the Megatron-Core MoE paper. Covers the Three Walls framework, parallel folding, recompute strategy, dispatcher choice, and CUDA-graph bring-up.
nemoclaw-user-configure-inference
nemoclaw
Connects NemoClaw to a local inference server. Use when setting up Ollama, vLLM, TensorRT-LLM, NIM, or any OpenAI-compatible local model server with NemoClaw. Trigger keywords - nemoclaw local inference, ollama nemoclaw, vllm nemoclaw, local model server, openai compatible endpoint, switch nemoclaw inference model, change inference runtime, nemoclaw additional model, nemoclaw sub-agent model, openclaw sub-agent, agents.list, sessions_spawn, vlm-demo, nemoclaw tool calling, ollama tool calls, vllm tool-call-parser, raw json in tui, nemoclaw inference options, nemoclaw onboarding providers, nemoclaw inference routing.
nemo-retriever
nemo
Use when the user wants to search, query, extract, transcribe, describe, quote, filter, or aggregate across documents — PDFs, scanned forms / images (`.jpg` `.png` `.tiff`), Office (`.docx` `.pptx`), text (`.html` `.txt`), audio (`.mp3` `.wav` `.m4a`), or video (`.mp4` `.mov`). Prefer this over native Read / Grep for multi-file or non-PDF corpora. Not for: editing files, web browsing, single-file plain-text lookups, fine-tuning.
nemo-mbridge-perf-hierarchical-context-parallel
nemo-mbridge
Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.
nemo-mbridge-perf-megatron-fsdp
nemo-mbridge
Operational guide for enabling Megatron FSDP in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.
nemo-rl-session-memory
nemo
Manage durable working-session memory for coding agents. Use when a user asks to preserve or recover agent context across disconnects, VS Code restarts, long-running work, handoffs, or any session where important state should be written periodically under the repo's session directory. Do NOT use for: simple questions, short tasks, one-off commands, linting, or code review.
nemoclaw-user-get-started
nemoclaw
Installs NemoClaw, launches a sandbox, and runs the first agent prompt. Use when onboarding, installing, or launching a NemoClaw sandbox for the first time. Trigger keywords - nemoclaw quickstart, install nemoclaw openclaw sandbox, nemohermes quickstart, hermes agent nemoclaw, run hermes openshell sandbox, nemoclaw prerequisites, nemoclaw supported platforms, nemoclaw hardware software, nemoclaw windows wsl2 setup, nemoclaw install windows docker desktop.
nemo-mbridge-perf-moe-vlm-training
nemo-mbridge
Practical guidance for training MoE VLMs in Megatron Bridge. Compares FSDP and 3D-parallel approaches, using rounded lessons from Qwen3-VL, Qwen3-Next, and other multimodal experiments.
nemoclaw-user-configure-security
nemoclaw
Presents a risk framework for every configurable security control in NemoClaw. Use when evaluating security posture, reviewing sandbox security defaults, or assessing control trade-offs. Trigger keywords - nemoclaw security best practices, sandbox security controls risk framework, nemoclaw credential storage, openshell provider, api key security, openclaw security controls, nemoclaw security boundary, prompt injection, tool access control.
nemoclaw-user-reference
nemoclaw
Describes the NemoClaw integration layer and blueprint architecture and how they orchestrate compatible agent sandboxes. Use when looking up architecture, agent integration, plugin structure, or blueprint design. Trigger keywords - nemoclaw architecture, nemoclaw agent architecture, nemoclaw plugin blueprint structure, nemoclaw vs openshell, which cli, nemoclaw cli, openshell cli, sandbox commands, nemoclaw cli commands, nemoclaw command reference, nemoclaw network policy, sandbox egress control operator approval, nemoclaw troubleshooting, nemoclaw debug sandbox issues.
nemo-mbridge-perf-memory-tuning
nemo-mbridge
Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.
nemoclaw-user-deploy-remote
nemoclaw
Explains how to run NemoClaw on a remote GPU instance, including the deprecated Brev compatibility path and the preferred installer plus onboard flow. Use when deploying NemoClaw to a remote VM, onboarding a Brev instance, or migrating away from the legacy `nemoclaw deploy` wrapper. Trigger keywords - deploy nemoclaw remote gpu, nemoclaw brev cloud deployment, nemoclaw plugins, openclaw plugins, install openclaw plugin, nemoclaw onboard from dockerfile, nemoclaw brev web ui, nemoclaw getting started, brev quickstart, nvidia nemotron agent, nemoclaw sandbox hardening, container security, docker capabilities, process limits.
nemoclaw-user-overview
nemoclaw
Explains how OpenClaw, OpenShell, and NemoClaw form the ecosystem, NemoClaw's position in the stack, what NemoClaw adds beyond the community sandbox, and when to prefer NemoClaw versus integrating OpenShell and OpenClaw directly. Use when users ask about the relationship between OpenClaw, OpenShell, and NemoClaw, or when to use NemoClaw versus OpenShell. Trigger keywords - nemoclaw ecosystem, openclaw openshell, nemoclaw vs openshell, sandboxed openclaw, how nemoclaw works, nemoclaw sandbox lifecycle blueprint, nemoclaw overview, openclaw always-on assistants, nvidia openshell, nvidia nemotron, nemoclaw release notes, nemoclaw changelog.
nemo-mbridge-perf-parallelism-strategies
nemo-mbridge
Operational guide for choosing and combining parallelism strategies in Megatron Bridge, including sizing rules, hardware topology mapping, and combined parallelism configuration.
jetson-generate-kb
jetson
>-
jetson-quick-start
jetson
>-
jetson-diagnostic
jetson
Read-only Jetson health snapshot for identity, memory, GPU, thermal, power, storage, services, and top processes.
jetson-flash-image
jetson
Use to flash a promoted BSP image to a Jetson DUT in RCM mode via flash.sh or l4t_initrd_flash.sh. Do NOT use for BSP customization, image promotion, or carrier derivation.
jetson-download-bsp
jetson
>-
jetson-customize-fan
jetson
>-
jetson-derive-carrier
jetson
>-
jetson-promote-image
jetson
>-
jetson-validate-image
jetson
>-
jetson-customize-clocks
jetson
Use to lock/cap Jetson CPU/GPU/EMC clocks, toggle EMC/CPU DVFS, or change cpufreq governors by editing BPMP DTB and nvpower.sh pre-flash. Do NOT use for live tuning or nvpmodel edits.
jetson-customize-mgbe
jetson
>-
jetson-link-docs
jetson
>-
jetson-print-device-info
jetson
Use when you need to print Jetson device info (module model, L4T version, kernel, OS version, current power mode) from a running Jetson target. This is an example skill.
jetson-init-target
jetson
>-
nemo-mbridge-perf-cuda-graphs
nemo-mbridge
Validate and use CUDA graph capture in Megatron Bridge, including local full-iteration graphs and Transformer Engine scoped graphs for attention, MLP, and MoE modules.
jetson-speculative-decoding
jetson
Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.
nemo-mbridge-perf-cpu-offloading
nemo-mbridge
Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.
nemo-mbridge-perf-activation-recompute
nemo-mbridge
Validate and use selective and full activation recompute in Megatron Bridge to reduce GPU memory usage at the cost of extra compute.
jetson-customize-uphy
jetson
Configure Jetson UPHY lane allocation (uphy0/uphy1-config) on Orin/Thor custom carriers. Do NOT use for pinmux or PCIe-only edits.
nemo-mbridge-mlm-bridge-training
nemo-mbridge
Run Megatron-LM (MLM) and Megatron Bridge training with mock or real data. Covers correlation testing, available recipes, and multi-GPU examples.
nemo-evaluator-plugin
nemo
Use when working on the Evaluator plugin CLI, jobs, SDK-backed specs, metric types, or plugin-owned Evaluator skills.
mcore-split-pr
mcore
Split a PR into multiple PRs to reduce the number of required CODEOWNERS reviewer groups.
jetson-init-source
jetson
>-
nemo-mbridge-multi-node-slurm
nemo-mbridge
Convert single-node scripts to multi-node Slurm sbatch jobs and debug common multi-node failures. Covers srun-native vs uv run torch.distributed approaches, container setup, NCCL timeouts, OOM sizing for MoE models, and interactive allocation.
nemo-automodel-recipe-development
nemo
Create and modify NeMo AutoModel training and evaluation recipes, including YAML structure, builders, and execution flow.
nemo-data-designer-plugin
nemo
Use when the user wants to create a dataset, generate synthetic data, or build a data generation pipeline.
jetson-customize-pinmux
jetson
>-
nemo-automodel-model-onboarding
nemo
Guide for onboarding new model architectures into NeMo AutoModel, including architecture discovery, implementation patterns, registration, and validation.
jetson-package
jetson
Pick Jetson-compatible containers, vLLM runtime images, and Jetson AI Lab PyPI indexes; maps Orin SM 8.7 vs Thor SM 11.0 and JetPack-specific package choices.
nemo-automodel-launcher-config
nemo
Configure NeMo AutoModel job launches for interactive runs, Slurm clusters, and SkyPilot cloud execution.
jetson-optimize-memory
jetson
>-
nemo-automodel-distributed-training
nemo
Guide for selecting and configuring distributed training strategies in NeMo AutoModel, including FSDP2, Megatron FSDP, DDP, and parallelism settings.
jetson-memory-audit
jetson
Measure Jetson DRAM/NvMap usage and verify before/after memory reclamation with live audit data.
jetson-llm-serve
jetson
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
jetson-customize-camera
jetson
>-
mcore-testing
mcore
Test system for Megatron-LM. Covers test layout, recipe YAML structure, adding and running unit and functional tests, golden values, marker filters, and CI parity.
jetson-build-source
jetson
>-
mcore-create-issue
mcore
Investigate a failing GitHub Actions run or job and create a GitHub issue for the failure.
jetson-inference-mem-tune
jetson
Pick the serving stack and per-runtime memory flags (vLLM, SGLang, llama.cpp, TensorRT Edge-LLM) for an LLM/VLM workload on any NVIDIA Jetson.
mcore-linting-and-formatting
mcore
Linting and formatting for Megatron-LM. Covers running autoformat.sh, tools (ruff, black, isort, pylint, mypy), and code style rules.
jetson-init-image
jetson
>-
mcore-run-on-slurm
mcore
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.
jetson-customize-nvpmodel
jetson
>-
jetson-customize-pcie
jetson
>-
jetson-headless-mode
jetson
Plan and apply safe Jetson headless-mode changes to reclaim GUI and daemon memory.
jetson-customize-usb
jetson
Enable/disable Jetson USB2/USB3 SS ports via kernel-DT overlay. Do NOT use for UPHY lane allocation or ODMDATA edits.
jetson-set-target
jetson
>-
jetson-print-bsp-info
jetson
Use when you need to print Jetson BSP info (L4T version, board configs, rootfs state) from a Linux_for_Tegra root on the host PC. This is an example skill.
jetson-llm-benchmark
jetson
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
launch-nemo-rl
accelerated-computing
Playbook for launching, monitoring, stopping, and debugging NeMo-RL recipes on a Kubernetes cluster via the nrl-k8s CLI. Covers ephemeral vs long-lived RayCluster modes, iterating on runs, and debugging hung or failed training jobs.
cuopt-numerical-optimization-formulation
cuopt
LP, MILP, QP — concepts, problem-text parsing, and formulation patterns (parameters, constraints, decisions, objective). Concepts only; no API.
digital-health-clinical-asr-build
digital-health
Stage 2 of the Clinical ASR Flywheel. Use when curating clinical terms, tagging IPA, and synthesizing a NeMo manifest. NOT for scoring (use /digital-health-clinical-asr-eval).
hsb-test
hsb
Execute QA test plans on Holoscan Sensor Bridge hardware. Reads a user-provided test document, filters tests by the user's setup, determines which tests can run automatically, executes them with pass/fail evaluation, and produces a structured test results report.
hsb-setup
hsb
Clone the latest NVIDIA Holoscan Sensor Bridge repo, ask which supported devkit is being used, configure the host per platform, build the correct demo container, run it, and verify HSB connectivity by pinging 192.168.0.2. Use for Holoscan Sensor Bridge setup, build, container launch, and first-connectivity bring-up.
cupynumeric-hdf5
cupynumeric
>-
holoscan-setup
holoscan
Guides Holoscan SDK installation: inspects the host, assesses platform compatibility, recommends an install method, and delegates to the matching install skill.
dicom-series-to-volume
dicom
Used for converting one CT DICOM series folder to a HU NIfTI volume with affine evidence. Not for multi-frame DICOM or clinical use.
holoscan-install-container
holoscan
Install Holoscan SDK via the NGC Docker container. Use for container-based installs; not for native apt/pip/Conda installs.
hsb-flash
hsb
Flash the FPGA on an HSB board connected to an NVIDIA devkit. Supports HSB Lattice boards (FPGA versions 2407, 2412, 2507, 2510) and Leopard Imaging VB1940 "all-in-one" cameras (FPGA versions 2507, 2510). Uses release-specific YAML manifests and board-type-specific program commands. Lattice and VB1940 commands must never be mixed.
hsb-app
hsb
Discover and run Holoscan Sensor Bridge example applications on a connected devkit. Filters available apps by the user's platform, HSB software version, board type, and sensors. Supports timed execution, failure analysis, code-edit suggestions, and iterative re-runs.
earth2studio-data-fetch
earth2studio
>
earth2studio-deterministic-forecast
earth2studio
>
holoscan-install-wheel
holoscan
Install Holoscan SDK Python wheel via pip into a venv. Use for Python installs; not for native C++/apt or Conda installs.
holoscan-install-conda
holoscan
Install Holoscan SDK v4.3+ via Conda in a CUDA 13 environment. Use for Conda installs; redirect CUDA 12 hosts to container/wheel.
dynamo-troubleshoot
dynamo
Diagnose failed or unhealthy Dynamo deployments. Use when pods, model-cache jobs, PVCs, workers, frontend/router health, endpoints, or benchmark jobs fail; use recipe-runner/router-starter before this for normal bring-up.
earth2studio-discover
earth2studio
>
dynamo-recipe-runner
dynamo
Select, validate, patch, and deploy existing NVIDIA Dynamo Kubernetes recipes. Use for model/backend/GPU/deployment-mode recipe bring-up; use router-starter for router-only mode work and troubleshoot for broken deployments.
holoscan-install-debian
holoscan
Install Holoscan SDK natively on Ubuntu via apt. Use for C++ installs on Ubuntu; pair with /holoscan-install-wheel for Python.
holoscan-install-source
holoscan
Build Holoscan SDK from source via the in-tree ./run script. Use only when published packages don't meet the user's needs.
digital-health-clinical-asr-setup
digital-health
Stage 1 of Clinical ASR Flywheel. Use when bootstrapping a cycle: NVCF+MW disclosure, NVIDIA_API_KEY check, deps install, TTS+ASR smoke test.
dicom-series-preflight
dicom
Used for header-only preflight of one DICOM series folder before conversion or inference. Not for de-identification or clinical clearance.
aiq-deploy
aiq
|
cudaq-guide
accelerated-computing
CUDA-Q onboarding guide for installation, test programs, GPU simulation, QPU hardware, and quantum applications.
cuopt-install
cuopt
Install cuOpt for Python, C, or server via pip, conda, or Docker; verify the install. For building cuOpt from source, see cuopt-developer.
cuopt-server-api-python
cuopt
cuOpt REST server — start server, endpoints, Python/curl client examples. Use when the user is deploying or calling the REST API.
digital-health-clinical-asr-finetune
digital-health
Stage 4 of the Clinical ASR Flywheel. Use when priority KER is above 0.3 to run stock NeMo SFT on Parakeet TDT v2 and offline cycle N+1 re-eval. NOT for generic word boosting (use /finetune-asr).
dynamo-router-starter
dynamo
Start or patch Dynamo router modes and run router endpoint smoke checks. Use for round-robin, KV-aware, least-loaded, or device-aware routing setup; use recipe-runner for recipe deployment and troubleshoot for failure diagnosis.
deepstream-import-vision-model
accelerated-computing
>
dynamo-interconnect-check
dynamo
Validate that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink. Use after recipe-runner brings a deployment up (especially disagg/multi-node) to confirm the KV transport is correct; use troubleshoot for diagnosing already-failed pods.
digital-health-clinical-asr-eval
digital-health
Stage 3 of Clinical ASR Flywheel. Score a NeMo manifest, produce the five-section KER leaderboard (by-ipa_source diagnostic). Not for ASR auth (/riva-asr).
cuopt-routing-formulation
cuopt
Vehicle routing (VRP, TSP, PDP) — problem types and data requirements. Domain concepts; no API or interface.
dicom-metadata-extract
dicom
Used for extracting selected metadata from one DICOM file and flagging standard-tag PHI presence. Not for anonymization or clinical use.
aiq-research
aiq
|
cufolio
accelerated-computing
Use when a user asks to build, optimize, backtest, rebalance, or analyze a stock portfolio with Mean-CVaR, efficient frontiers, scenario generation, or NVIDIA cuOpt.
deepstream-dev
accelerated-computing
NVIDIA DeepStream SDK 9.0 development with Python pyservicemaker API. Use when building video analytics pipelines, GStreamer-based video processing, TensorRT inference integration, object detection/tracking, or Kafka/message broker integration.
cuopt-developer
cuopt
Modify, build, test, debug, and contribute to NVIDIA cuOpt (C++/CUDA, Python, server, CI). Use for solver internals, PRs, DCO, and code conventions.
cuopt-numerical-optimization-api-c
cuopt
LP, MILP, and QP (beta) with cuOpt — C API only. Use when the user is embedding LP, MILP, or QP in C/C++.
cuopt-numerical-optimization-api-python
cuopt
Solve LP, MILP, QP (beta) with cuOpt Python API — linear/quadratic objectives, integer variables, scheduling, portfolio, least squares.
cuopt-routing-api-python
cuopt
Vehicle routing (VRP, TSP, PDP) with cuOpt — Python API only. Use when the user is building or solving routing in Python.
cuopt-numerical-optimization-api-cli
cuopt
LP, MILP, and QP (beta) with cuOpt — CLI only (MPS files, cuopt_cli). Use when the user is solving LP, MILP, or QP from MPS via command line.
cuopt-server-common
cuopt
cuOpt REST server — what it does and how requests flow. Domain concepts; no deploy or client code.
cupynumeric-parallel-data-load
cupynumeric
Load a sharded, on-disk dataset (sharded .npy, Parquet/Arrow, raw binary, sharded HDF5, custom layouts) into a distributed cuPyNumeric ndarray via a manual partition + leaf @task launch with CPU/OMP/GPU variants. Use when no single-call loader fits, including when per-shard row counts differ across files. Prefer cupynumeric.load or legate.io.hdf5.from_file when they apply.
data-designer
data-designer
Use when the user wants to create a dataset, generate synthetic data, or build a data generation pipeline.
cupynumeric-migration-readiness
cupynumeric
Pre-migration readiness assessor for porting NumPy to cuPyNumeric. Use BEFORE substantial porting work begins when the user asks whether code will scale on GPU, whether they should migrate to cuPyNumeric, which NumPy patterns transfer cleanly, what must be refactored before porting, or mentions pre-port assessment, scaling analysis, or refactor planning. Inspect the user's source code, look up NumPy usage, cross-reference the cuPyNumeric API support manifest, and distinguish distributed-scaling-friendly patterns from blockers such as unsupported APIs, scalar synchronization, host round-trips, Python/object-heavy control flow, shape/data-dependent branching, and in-place mutation hazards. Produce a verdict of READY, LIGHT REFACTOR, SIGNIFICANT REFACTOR, or NOT RECOMMENDED, with concrete refactor pointers.
dali-dynamic-mode
accelerated-computing
DALI imperative dynamic mode (`nvidia.dali.experimental.dynamic`, ndd): use when working on ndd code or migrating pipelines; skip pipeline-only tasks.
cupynumeric-install
cupynumeric
Install and verify cuPyNumeric for Python — requirements, commands, verification. Source builds are out of scope.
cuopt-user-rules
cuopt
Base rules for end users calling NVIDIA cuOpt (routing/LP/MILP/QP/install/server). Not for cuOpt internals — use cuopt-developer for those.
accelerated-computing-cudf
accelerated-computing
Official NVIDIA-authored guidance for NVIDIA cuDF GPU DataFrames, pandas acceleration, dask-cuDF, ETL, joins, groupby, CSV/Parquet I/O, nullable semantics, and multi-GPU DataFrame workloads.