Bring in Rules.md and YAML schema#222
Bring in Rules.md and YAML schema#222FileSystemGuy wants to merge 23 commits intoTF_Modernizationfrom
Conversation
Expanded the directory structure requirements for CLOSED and OPEN submissions, detailing the necessary files and their organization within the submission structure.
Updated submission guidelines and directory structure requirements for OPEN and CLOSED benchmarks, including detailed validation checks and file requirements.
Remove all the text that carried over from the Submission_guidelines.md file, and start filling out the main structure of the sections of the new document.
Updated sections for validating training options and checkpointing options in the rules document.
Removed section on validating phases and its related content.
Reorganize the sections under 'Validating the Checkpointing Options' for clarity.
First drraft of a schema for the SystemDescription.yaml files created by submitters. This is in the format required by Yamale.
Add README for submission validation checker directory
|
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅ |
|
I plan to reformat the text to include a short title when I get a chance. If this PR has not yet been merged into Modernization when I'm ready to do that work, I'll do the work in my branch and do another PR to bring it into Modernization. |
Clarify the meaning of two rules.
Updated rules to clarify requirements and add description tokens for each section.
|
FYI: PR mlcommons/inference_policies#324 for proposed YAML for PSU data. We'll want to start working on integrating this into the YAML. |
|
This PR adds a file to the submission checker, which is Pablo's area, and should not be in this PR. It also defines the SystemDescription_Schema.yaml, which David Slik has been working on, so we should wait for his version to come in rather than making him merge his changes into this file. The Rules.md file will be merged via a new PR#267. |
2 participants
This brings in the latest version of the Rules.md file, and an early snapshot of the ongoing development of the YAML schema checker. Future Rules.md development should be done in the Modernization branch (ie: I'll stop working on it in my branch), but since @dslik is working on the Schema (based in my branch), he will need to decide how to get his work into the Modernization branch.