Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions that arise when studying your code #120

Open
bulaikexiansheng opened this issue Aug 16, 2024 · 2 comments
Open

Some questions that arise when studying your code #120

bulaikexiansheng opened this issue Aug 16, 2024 · 2 comments

Comments

@bulaikexiansheng
Copy link

Thank you for your excellent work! I learned a lot from it!
But I have a question when studying your code. Like your work with Medusa, there is a variable called tree_choices, mc_sim_7b_63, as well as tree_indices, retrieve_indices. Can you share what these variables mean?

@bulaikexiansheng
Copy link
Author

bulaikexiansheng commented Aug 16, 2024

I have run Medusa code and trained the draft model. I found that it also needs to run the script to generate corresponding choices for the trained model. It seems to be the path of the tree? I don't quite understand the meaning of this. This variable needs to be imported into choices.py

@Liyuhui-12
Copy link
Collaborator

In EAGLE, mc_sim_7b_63 represents the structure of the tree; see #6 for details. In EAGLE-2, the tree structure is dynamically determined based on the context, so this variable has been deprecated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants