gprovost Posted March 14, 2019 Posted March 14, 2019 @Igor Could we imagine another mechanism than to use git as an "upload front-end" ? Using git as some kind of spool folder is really not ideal. For instance if I clone today the armbian upload git project the size of the objects is already reaching 1.2 GB for a project that is essentially just a structure of empty folders. I even see the following error during cloning Cloning into 'upload'... remote: Enumerating objects: 75, done. remote: Counting objects: 100% (75/75), done. remote: Compressing objects: 100% (61/61), done. kex protocol error: type 7 seq 49316022.52 MiB | 6.67 MiB/s remote: Total 844 (delta 33), reused 40 (delta 14), pack-reused 769 Receiving objects: 100% (844/844), 1.22 GiB | 6.03 MiB/s, done. Resolving deltas: 100% (251/251), done. The easier would be to provide a FTP service with the same structure and limited access to people you grant right to upload.
lanefu Posted March 14, 2019 Posted March 14, 2019 (edited) On 3/14/2019 at 8:38 AM, gprovost said: @Igor Could we imagine another mechanism than to use git as an "upload front-end" ? Using git as some kind of spool folder is really not ideal. For instance if I clone today the armbian upload git project the size of the objects is already reaching 1.2 GB for a project that is essentially just a structure of empty folders. I even see the following error during cloning Cloning into 'upload'... remote: Enumerating objects: 75, done. remote: Counting objects: 100% (75/75), done. remote: Compressing objects: 100% (61/61), done. kex protocol error: type 7 seq 49316022.52 MiB | 6.67 MiB/s remote: Total 844 (delta 33), reused 40 (delta 14), pack-reused 769 Receiving objects: 100% (844/844), 1.22 GiB | 6.03 MiB/s, done. Resolving deltas: 100% (251/251), done. The easier would be to provide a FTP service with the same structure and limited access to people you grant right to upload. Expand Is it for long term storage, or just for exchanging data.... I could setup some object storage.. i think there's even an official SFTP gateway fro s3 now. Edited March 14, 2019 by Tido fixed quote
Igor Posted March 14, 2019 Posted March 14, 2019 On 3/14/2019 at 8:38 AM, gprovost said: is really not ideal Expand I agree with that. It was designed for quick fixes, upload via web ... and that works ... until file is not too big I realized that later that sources packages are out of range. Will do something on a long run.
Igor Posted March 14, 2019 Posted March 14, 2019 On 3/14/2019 at 4:56 PM, lanefu said: i think there's even an official SFTP gateway fro s3 now. Expand I can open incoming directory for direct upload, but since it's not a total urgent matter it can wait a while. 1
Igor Posted April 8, 2019 Posted April 8, 2019 On 3/14/2019 at 8:38 AM, gprovost said: The easier would be to provide a FTP service with the same structure and limited access to people you grant right to upload. Expand Prepared. Anyone needs a (s)ftp access to repository incoming directory should send me a public key. Structure is the same as from the build script.
gprovost Posted April 8, 2019 Author Posted April 8, 2019 On 4/8/2019 at 5:01 AM, Igor said: Prepared. Anyone needs a (s)ftp access to repository incoming directory should send me a public key. Structure is the same as from the build script. Expand Great ! Just sent you my pub key by PM ;-)
Igor Posted April 8, 2019 Posted April 8, 2019 OK, gimme me some time. While adding some fixes this morning I find out troubles with repository (nothing can be added atm) and I have to rebuild it manually. For now adding will remain manual - this is just a direct drop off.
gprovost Posted April 9, 2019 Author Posted April 9, 2019 Sure, no rush... on my side I don't have any package to push. BTW what will be the sftp address ?
Igor Posted May 27, 2019 Posted May 27, 2019 On 5/27/2019 at 7:14 AM, gprovost said: Hi @Igor Is the SFTP upload available ? Expand Have to check once again. IIRC I stuck somewhere in the middle ...
Recommended Posts