Replace cycle detection algorithm with Tarjan's strongly connected components algorithm#49
Open
hedgepigdaniel wants to merge 2 commits intoaackerman:masterfrom
Open
Replace cycle detection algorithm with Tarjan's strongly connected components algorithm#49hedgepigdaniel wants to merge 2 commits intoaackerman:masterfrom
hedgepigdaniel wants to merge 2 commits intoaackerman:masterfrom
Conversation
…forcing that no warning is generated if all files in a cycle are excluded
Owner
|
Thanks for sending this, I appreciate the effort that went into this. Since this reworks a lot of the core functionality I'll have to spend some time reviewing it, and I probably won't get to it until the weekend, I'll try to do a thorough review as soon as I can. |
|
This is a great contribution. Wish we had it merged. |
|
Was it benchmarked maybe? |
|
Any update on that? |
|
Is there any hope for this improvement? |
|
We've opted to depend on this improvement directly: package.json snippet "circular-dependency-plugin": "https://github.com/hedgepigdaniel/circular-dependency-plugin#303a29632dcbc663d6b190c84d727d29761acec5",Huge thanks, makes a big impact on CI times 💯 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
I noticed that this plugin was taking significant time (almost a second for a 5500 module project) to check for cycles in hot rebuilds. Tarjan's strongly connected components algorithm as I understand is the fastest way to find dependency cycles. Its running time is linear in the number of vertices (modules) + edges (dependencies).
My best guess is that the existing algorithm is quadratic in the number of modules, because for each module in the compilation, all its dependencies are traversed recursively, which in the worst case also visits each module in the compilation.
I haven't done benchmarks, but in the same project after this change, this plugin is no longer perceptible in the ProgressPlugin output.
I also changed the output:
a.js -> b.jseven ifa.jsdoes not directly importb.js, which is confusing. If all modules in a cycle are excluded, no warning is generated (I added a test to enforce this)