Skip to content

Dataset · code-search-net

2M comment-code pairs

code-search-net/code_search_net

Documentation and code pairs from GitHub for natural language code search and code model training.

What's inside

The CodeSearchNet corpus contains approximately 2 million (comment, code) pairs from open-source GitHub libraries. It features code and documentation in multiple programming languages. The dataset was gathered for the CodeSearchNet challenge, focusing on code retrieval via natural language descriptions.

What you can do with it

  • Training and evaluating code retrieval by description
  • Fine-tuning code generation models
  • Training fill-mask on code
Tasks
Text generation, Fill mask
Languages
Code
Size
1M–10M rows
Downloads this month
39.6K
Likes
354

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("code-search-net/code_search_net")