Skip to content

Gitextractor supports incremental collection - #7319

Merged
abeizn merged 6 commits into
mainfrom
kw-gitext-diffsync
Apr 12, 2024
Merged

abeizn merged 6 commits into
mainfrom
kw-gitext-diffsync

Conversation

@klesh

@klesh klesh commented Apr 12, 2024

Copy link
Copy Markdown
Contributor

Summary

With the previous PR #7278 and #7315 got merged, gitextractor supports timeAfter collection, which is still quite limited when collecting huge repos:

  1. All commits since timeAfter would be cloned every time
  2. All added/deleted lines since timeAfter would be calculated every time

Which is quite a waste of time.

With this optimization, gitextractor can smarty clone and collect only new data since the previous collection.

@abeizn
abeizn merged commit c66d847 into main Apr 12, 2024
@abeizn
abeizn deleted the kw-gitext-diffsync branch April 12, 2024 11:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants