Skip to content

Commit

Permalink
Merge pull request #175 from ssh-randy/patch-1
Browse files Browse the repository at this point in the history
Fix link in collect README.md
  • Loading branch information
john-b-yang authored Jul 10, 2024
2 parents c762296 + 586eb1e commit a39c279
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions swebench/collect/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Data Collection
This folder includes the code for the first two parts of the benchmark construction procedure as described in the paper, specifically 1. Repo selection and data scraping, and 2. Attribute-based filtering.

We include a comprehensive [tutorial](https://github.com/princeton-nlp/SWE-bench/tree/main/swebench/collect/collection.md.md) that describes the end-to-end procedure for collecting evaluation task instances from PyPI repositories.
We include a comprehensive [tutorial](https://github.com/princeton-nlp/SWE-bench/tree/main/swebench/collect/collection.md) that describes the end-to-end procedure for collecting evaluation task instances from PyPI repositories.

> SWE-bench's collection pipeline is currently designed to target PyPI packages. We hope to expand SWE-bench to more repositories and languages in the future.
Expand Down Expand Up @@ -51,4 +51,4 @@ In this section, we briefly describe each of the files in this directory and its
* Usage: `python delete_gh_workflows.py <repo URL>`
* `remove_envs.py`
* Purpose: SWE Bench's evaluation + validation harnesses rely on the creation of multiple virtual environments with conda to speed up benchmark evaluation. Use these script to parallelize conda environment removal for environments named with the same prefix.
* Usage: `python remove_envs.py <prefix> --conda_path <path to conda installation>`
* Usage: `python remove_envs.py <prefix> --conda_path <path to conda installation>`

0 comments on commit a39c279

Please sign in to comment.