Commit Briefs

e44d939152 Stefan Sperling

revert object enumeration in got-read-pack for now; needs more work

This implementation marked commits and trees as enumerated before all trees which they depend on were enumerated. This behaviour leads to incomplete pack files when a tree is only partially packed and got-read-pack hits a missing tree entry as a result. The algorithm must be reworked such that packed leave nodes are marked enumerated first, then bubble-up. Found by op@


cee6a7ea55 Stefan Sperling

implement object enumeration support in got-read-pack

ok op@


fae7e03842 Stefan Sperling

run the search for deltas to reuse in got-read-pack

This significantly speeds up the deltification step of packing by avoiding imsg traffic. gotadmin no longer requests individual raw deltas from got-read-pack to check whether it can reuse them. Instead, got-read-pack obtains a list of objects we want to pack, and hands back the list of all deltas in its pack file which can be reused. Messages are now batched such that imsg buffers are filled as much as possible. Another advantage is that deltas we are not going to reuse will no longer be written to the delta cache file, saving disk space. Before this patch, any raw delta candidate was written to the delta cache file by got-read-pack, and the decision whether to reuse the delta happened afterwards in the gotadmin process. Code for reading individual raw deltas is now unused and could be removed at some point. ok op@


2d9e6abf24 Stefan Sperling

store deltas in compressed form while packing, both in memory and cache file

This reduces memory and disk space consumption during packing. with tweaks + memleak on error fix from op@ ok op@


d7b5a0e827 Stefan Sperling

inline struct got_object_id in struct got_object_qid

Saves us from doing a malloc/free call for every item on the list. ok op@


67fd684965 Stefan Sperling

reuse existing deltas when creating pack files

tested by thomas, naddy, and myself


64a8571e12 Stefan Sperling

map raw object files into memory while packing if possible



284e766353 Stefan Sperling

remove unused internal raw object API functions


d3c116bf72 Stefan Sperling

cache raw objects in order to speed up gotadmin pack




b3d68e7f99 Stefan Sperling

implement 'gotadmin cleanup'





5aa813935b Stefan Sperling

add copyright year for files already touched in 2020


2c98ee284c Stefan Sperling

NAME_MAX does not account for a terminating NUL


56e0773df7 Stefan Sperling

convert tree entries from SIMPLEQ to an array



8aa93786da Stefan Sperling

make 'got cat' output look more like raw object files


ed17542722 Stefan Sperling

more progress on generating new tree entries


90bdb554ae Stefan Sperling

expose a static helper function as got_object_get_path()


e02fc99fa1 Stefan Sperling

move declaration of object labels to got_lib_object.h


5d56da8198 Stefan Sperling

happy new copyright year