Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update training config in CLI to reflect new options (8B support) #287

Open
Tracked by #2483
ktam3 opened this issue Oct 21, 2024 · 2 comments
Open
Tracked by #2483

Update training config in CLI to reflect new options (8B support) #287

ktam3 opened this issue Oct 21, 2024 · 2 comments
Assignees

Comments

@ktam3
Copy link

ktam3 commented Oct 21, 2024

Goal:

Provide high-level goal statement; providing user context and expected user outcome(s) for this Epic. 2-3 sentences...

Update training config in CLI to reflect new options

Acceptance Criteria:

The Acceptance Criteria provides a definition of scope and the expected outcomes - from a users point of view - defines the value proposition

  • Update description of is_padding_free flag
  • used_dolomite flag is introduced
  • Both need to be properly connected to training library and appropriately described in functionality.
@ktam3 ktam3 transferred this issue from instructlab/instructlab Oct 21, 2024
@ktam3 ktam3 changed the title Update training config in CLI to reflect new options Update training config in CLI to reflect new options (8B support) Oct 22, 2024
@junzzhu
Copy link

junzzhu commented Oct 22, 2024

I wonder if the latest granite-3.0 is within the consideration, as there is a new model - https://huggingface.co/ibm-granite/granite-3.0-8b-base, which has different architecture/model_type from the previous granite-8b.

@ktam3
Copy link
Author

ktam3 commented Nov 15, 2024

This is related to the downstream configs Charlie is currently working on

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants