---
license: cc-by-4.0
task_categories:
- text-generation
tags:
- text
- pre-training
- human
- legal
- Nemotron_3_Ultra
language:
- code
size_categories:
- 100M<n<1B
configs:
- config_name: Nemotron-Code-Metadata
  data_files:
  - path:
    - Nemotron-Code-Metadata/part_00000.parquet
    - Nemotron-Code-Metadata/part_00001.parquet
    - Nemotron-Code-Metadata/part_00002.parquet
    - Nemotron-Code-Metadata/part_00003.parquet
    - Nemotron-Code-Metadata/part_00004.parquet
    - Nemotron-Code-Metadata/part_00005.parquet
    - Nemotron-Code-Metadata/part_00006.parquet
    - Nemotron-Code-Metadata/part_00007.parquet
    - Nemotron-Code-Metadata/part_00008.parquet
    - Nemotron-Code-Metadata/part_00009.parquet
    - Nemotron-Code-Metadata/part_00010.parquet
    - Nemotron-Code-Metadata/part_00011.parquet
    - Nemotron-Code-Metadata/part_00012.parquet
    - Nemotron-Code-Metadata/part_00013.parquet
    - Nemotron-Code-Metadata/part_00014.parquet
    - Nemotron-Code-Metadata/part_00015.parquet
    - Nemotron-Code-Metadata/part_00016.parquet
    - Nemotron-Code-Metadata/part_00017.parquet
    - Nemotron-Code-Metadata/part_00018.parquet
    - Nemotron-Code-Metadata/part_00019.parquet
    - Nemotron-Code-Metadata/part_00020.parquet
    - Nemotron-Code-Metadata/part_00021.parquet
    - Nemotron-Code-Metadata/part_00022.parquet
    - Nemotron-Code-Metadata/part_00023.parquet
    - Nemotron-Code-Metadata/part_00024.parquet
    - Nemotron-Code-Metadata/part_00025.parquet
    - Nemotron-Code-Metadata/part_00026.parquet
    - Nemotron-Code-Metadata/part_00027.parquet
    - Nemotron-Code-Metadata/part_00028.parquet
    - Nemotron-Code-Metadata/part_00029.parquet
    - Nemotron-Code-Metadata/part_00030.parquet
    - Nemotron-Code-Metadata/part_00031.parquet
    - Nemotron-Code-Metadata/part_00032.parquet
    - Nemotron-Code-Metadata/part_00033.parquet
    - Nemotron-Code-Metadata/part_00034.parquet
    - Nemotron-Code-Metadata/part_00035.parquet
    - Nemotron-Code-Metadata/part_00036.parquet
    - Nemotron-Code-Metadata/part_00037.parquet
    - Nemotron-Code-Metadata/part_00038.parquet
    - Nemotron-Code-Metadata/part_00039.parquet
    - Nemotron-Code-Metadata/part_00040.parquet
    - Nemotron-Code-Metadata/part_00041.parquet
    - Nemotron-Code-Metadata/part_00042.parquet
    - Nemotron-Code-Metadata/part_00043.parquet
    - Nemotron-Code-Metadata/part_00044.parquet
    - Nemotron-Code-Metadata/part_00045.parquet
    - Nemotron-Code-Metadata/part_00046.parquet
    - Nemotron-Code-Metadata/part_00047.parquet
    - Nemotron-Code-Metadata/part_00048.parquet
    - Nemotron-Code-Metadata/part_00049.parquet
    - Nemotron-Code-Metadata/part_00050.parquet
    - Nemotron-Code-Metadata/part_00051.parquet
    - Nemotron-Code-Metadata/part_00052.parquet
    - Nemotron-Code-Metadata/part_00053.parquet
    - Nemotron-Code-Metadata/part_00054.parquet
    - Nemotron-Code-Metadata/part_00055.parquet
    - Nemotron-Code-Metadata/part_00056.parquet
    - Nemotron-Code-Metadata/part_00058.parquet
    - Nemotron-Code-Metadata/part_00059.parquet
    - Nemotron-Code-Metadata/part_00060.parquet
    - Nemotron-Code-Metadata/part_00061.parquet
    - Nemotron-Code-Metadata/part_00062.parquet
    - Nemotron-Code-Metadata/part_00063.parquet
    split: train
track_downloads: true
---
# Nemotron-Pretraining-Code-v3

## Dataset Description:

The [Nemotron-Pretraining-Code-v3](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v3) dataset is part of the [Nemotron Pretraining Data](https://huggingface.co/collections/nvidia/nemotron-pre-training-datasets) collection of pretraining datasets. Designed for the [NVIDIA Nemotron 3](https://huggingface.co/collections/nvidia/nvidia-nemotron-v3) family of LLMs, this dataset is intended to improve the coding capabilities of LLMs.

The [Nemotron-Pretraining-Code-v3](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v3) dataset contains the metadata corresponding to the raw source-code update to our [Nemotron-Pretraining-Code-v2](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v2) and [Nemotron-Pretraining-Code-v1](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v1) source-code corpora. It adds 146 M new files (173 B tokens) from GitHub (with a cut-off date of September 30, 2025). **This dataset contains only incrementally new files and is meant to be used jointly with the v2 and v1 corpora.**

The dataset contains a single split Nemotron-Code-Metadata with the following columns:

- **commit_id:** The first seven characters of the Git commit hash
- **rel_path:** The file path of the content relative to the repository root directory
- **language:** The detected programming language of the content

This dataset is ready for commercial use.

## Dataset Owner(s):

NVIDIA Corporation

## Dataset Creation Date:

05/18/2026

## Version:

[Nemotron-Pretraining-Code-v3](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v3)

Previous Version(s):
- [Nemotron-Pretraining-Code-v2](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v2)
- [Nemotron-Pretraining-Code-v1](https://huggingface.co/datasets/nvidia/Nemotron-Pretraining-Code-v1)

Relationship to Previous Version(s): This is an **extension** of the previously released datasets. They are meant to be used together.

## License/Terms of Use:

The **Nemotron-Pretraining-Code-v3** dataset is licensed under the [Creative Commons Attribution 4.0 International License](https://creativecommons.org/licenses/by/4.0/) (CC-BY-4.0).

## Intended Usage:

The Nemotron-Pretaining-Code-v3 Dataset is intended to be used by the community to continue to improve open models.

## Dataset Characterization

Data Collection Method: Automated

Labeling Method: Automated

## Dataset Format

Modality: Text

Format: Parquet

## Dataset Quantification

Record Count: 146.3M samples

Measurement of Total Data Storage: 8.2 GB

## Reference(s):

If  you  use  our  dataset  in  your  research,  please  cite  our  [NVIDIA  Nemotron  3  Ultra  tech  report](https://research.nvidia.com/labs/nemotron/files/NVIDIA-Nemotron-3-Ultra-Technical-Report.pdf).

## Ethical Considerations:

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. Developers should work with their internal developer teams to ensure this dataset meets requirements for the relevant industry and use case and addresses unforeseen product misuse.

Please report quality, risk, security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).