| --- |
| language: |
| - en |
| license: apache-2.0 |
| pipeline_tag: text-generation |
| tags: |
| - chess |
| - neuron |
| - aws-trainium |
| - vllm |
| - optimum-neuron |
| - continuous-batching |
| base_model: karanps/ChessLM_Qwen3 |
| --- |
| |
| # ChessLM Qwen3 - Neuron Traced (AWS Format Structure) |
|
|
| This is a Neuron-traced version of [karanps/ChessLM_Qwen3](https://huggingface.co/karanps/ChessLM_Qwen3) optimized for AWS Trainium (trn2) instances using vLLM. |
|
|
| This model follows the AWS Neuron repository structure with separate directories for compiled artifacts. |
|
|
| This model is meant to be used from within the Neuron Workshop (https://github.com/aws-neuron/neuron-workshops) |
|
|
| ## Model Details |
|
|
| - **Base Model**: Qwen3-8B fine-tuned for chess |
| - **Compilation**: optimum-neuron[vllm]==0.3.0 |
| - **Compiler Version**: neuronxcc 2.21.33363.0 |
| - **Target Hardware**: AWS Trainium2 (trn2) |
| - **Precision**: BF16 |
| - **Tensor Parallelism**: 2 cores |
| - **Batch Size**: 4 (continuous batching enabled) |
| - **Max Sequence Length**: 2048 |
|
|
|
|
| ## Compilation instructions |
| ``` |
| optimum-cli export neuron \ |
| --model karanps/ChessLM_Qwen3 \ |
| --task text-generation \ |
| --sequence_length 2048 \ |
| --batch_size 4 \ |
| /home/ubuntu/environment/ml/qwen-chess/karanps/ChessLM_Qwen3_compiled |
| ``` |
|
|
| ### Key Files |
|
|
| - **context_encoding_model/**: Compiled NEFF files for processing initial prompt sequences (up to 2048 tokens) |
| - **token_generation_model/**: Compiled NEFF files for autoregressive token generation |
| - **layout_opt/**: Layout optimization artifacts from compilation |
| - **model.pt**: Main model file containing compiled graphs and embedded weights (17GB) |
| - **neuron_config.json**: Neuron compilation configuration |
|
|
| ## Model Files |
|
|
| | File | Purpose | |
| |------|---------| |
| | model.pt | Main model with embedded weights (17GB) | |
| | config.json | Base model configuration | |
| | neuron_config.json | Neuron compilation settings | |
| | tokenizer* | Tokenizer files for text processing | |
| |
| ## License |
| |
| This model inherits the license from the base model [karanps/ChessLM_Qwen3](https://huggingface.co/karanps/ChessLM_Qwen3). |
| |
| |
