{"id":"axolotl","name":"axolotl","summary":"Axolotlを用いたLLMのファインチューニングに関する専門的なガイダンス - YAML設定、100+モデル、LoRA/QLoRA、DPO/KTO/ORPO/GRPO、マルチモーダルサポート","body":"# Axolotl Skill\n\nComprehensive assistance with axolotl development, generated from official documentation.\n\n## When to Use This Skill\n\nThis skill should be triggered when:\n- Working with axolotl\n- Asking about axolotl features or APIs\n- Implementing axolotl solutions\n- Debugging axolotl code\n- Learning axolotl best practices\n\n## Quick Reference\n\n### Common Patterns\n\n**Pattern 1:** To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example:\n\n```\n./build/all_reduce_perf -b 8 -e 128M -f 2 -g 3\n```\n\n**Pattern 2:** Configure your model to use FSDP in the Axolotl yaml. For example:\n\n```\nfsdp_version: 2\nfsdp_config:\n  offload_params: true\n  state_dict_type: FULL_STATE_DICT\n  auto_wrap_policy: TRANSFORMER_BASED_WRAP\n  transformer_layer_cls_to_wrap: LlamaDecoderLayer\n  reshard_after_forward: true\n```\n\n**Pattern 3:** The context_parallel_size should be a divisor of the total number of GPUs. For example:\n\n```\ncontext_parallel_size\n```\n\n**Pattern 4:** For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context_parallel_size=4: Only 2 different batches processed per step (each split across 4 GPUs) - If your per-GPU micro_batch_size is 2, the global batch size decreases from 16 to 4\n\n```\ncontext_parallel_size=4\n```\n\n**Pattern 5:** Setting save_compressed: true in your configuration enables saving models in a compressed format, which: - Reduces disk space usage by approximately 40% - Maintains compatibility with vLLM for accelerated inference - Maintains compatibility with llmcompressor for further optimization (example: quantization)\n\n```\nsave_compressed: true\n```\n\n**Pattern 6:** Note It is not necessary to place your integration in the integrations folder. It can be in any location, so long as it’s installed in a package in your python env. See this repo for an example: https://github.com/axolotl-ai-cloud/diff-transformer\n\n```\nintegrations\n```\n\n**Pattern 7:** Handle both single-example and batched data. - single example: sample[‘input_ids’] is a list[int] - batched data: sample[‘input_ids’] is a list[list[int]]\n\n```\nutils.trainer.drop_long_seq(sample, sequence_len=2048, min_sequence_len=2)\n```\n\n### Example Code Patterns\n\n**Example 1** (python):\n```python\ncli.cloud.modal_.ModalCloud(config, app=None)\n```\n\n**Example 2** (python):\n```python\ncli.cloud.modal_.run_cmd(cmd, run_folder, volumes=None)\n```\n\n**Example 3** (python):\n```python\ncore.trainers.base.AxolotlTrainer(\n    *_args,\n    bench_data_collator=None,\n    eval_data_collator=None,\n    dataset_tags=None,\n    **kwargs,\n)\n```\n\n**Example 4** (python):\n```python\ncore.trainers.base.AxolotlTrainer.log(logs, start_time=None)\n```\n\n**Example 5** (python):\n```python\nprompt_strategies.input_output.RawInputOutputPrompter()\n```\n\n## Reference Files\n\nThis skill includes comprehensive documentation in `references/`:\n\n- **api.md** - Api documentation\n- **dataset-formats.md** - Dataset-Formats documentation\n- **other.md** - Other documentation\n\nUse `view` to read specific reference files when detailed information is needed.\n\n## Working with This Skill\n\n### For Beginners\nStart with the getting_started or tutorials reference files for foundational concepts.\n\n### For Specific Features\nUse the appropriate category reference file (api, guides, etc.) for detailed information.\n\n### For Code Examples\nThe quick reference section above contains common patterns extracted from the official docs.\n\n## Resources\n\n### references/\nOrganized documentation extracted from official sources. These files contain:\n- Detailed explanations\n- Code examples with language annotations\n- Links to original documentation\n- Table of contents for quick navigation\n\n### scripts/\nAdd helper scripts here for common automation tasks.\n\n### assets/\nAdd templates, boilerplate, or example projects here.\n\n## Notes\n\n- This skill was automatically generated from official documentation\n- Reference files preserve the structure and examples from source docs\n- Code examples include language detection for better syntax highlighting\n- Quick reference patterns are extracted from common usage examples in the docs\n\n## Updating\n\nTo refresh this skill with updated documentation:\n1. Re-run the scraper with the same configuration\n2. The skill will be rebuilt with the latest information","author":"@Orchestra-Research","ownerProfile":null,"authorContacts":null,"sourceUrl":"https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/main/03-fine-tuning/axolotl","license":"MIT","category":null,"lang":"en","tokens":1003,"stars":0,"calls30d":2,"claimed":false,"visibility":"public","origin":"crawler","version":"0.1.0","createdAt":"2026-08-22","updatedAt":"2026-08-22","files":[{"path":"references/dataset-formats.md","size":46043,"sha256":"08005105153166d0dac4746bed3e3b0ef87d62cb3380ec3288754d40c38d9833"},{"path":"references/index.md","size":199,"sha256":"663ea0eeae52868ab221cb5620784d72d3a3fc1775ad9d3b3ef83e4e6e06471d"}],"requires":{"mcp":[],"tools":[]},"safety":{"flags":[],"scannedAt":"2026-08-22","hasScripts":false,"networkEndpoints":["docs.axolotl.ai"]}}